00000001:02000400:2.0F:1784936426.112893:0:2960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_hostid 00000001:02000400:2.0:1784936447.092110:0:3181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1784936449.054168:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 723 MB/s 00000001:01000000:0.0:1784936449.309873:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 671 MB/s 00000001:01000000:2.0:1784936449.559657:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4359 MB/s 00000020:02000000:2.0:1784936450.702985:0:3273:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_207_ge7645ef 00000400:02000000:3.0F:1784936451.952531:0:3288:0:(api-ni.c:2824:lnet_startup_lndni()) Added LNI 192.168.204.101@tcp [8/256/0/180] 00008000:02000000:0.0:1784936455.971797:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1784936517.222819:0:5240:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784936528.127236:0:5777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784936528.127252:0:5777:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1784936528.127388:0:5777:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000007970dd55 00000080:02000400:2.0:1784936528.127399:0:5777:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1784936528.134473:0:5777:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1784936528.134486:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784936528.134526:0:5777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008f744c44) 00000020:00000080:2.0:1784936528.134546:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784936528.148926:0:5777:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784936528.149823:0:5777:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0F:1784936528.184039:0:5777:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1784936528.184094:0:5777:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784936528.184116:0:5777:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784936528.184166:0:5777:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784936528.184191:0:5777:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784936528.184611:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784936528.184619:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784936528.184631:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f5594 00000020:01000004:1.0:1784936528.184639:0:5777:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1784936528.184644:0:5777:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784936528.184648:0:5777:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007970dd55 from MGS 00000020:01000004:1.0:1784936528.184652:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784936528.184672:0:5777:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e47d2e16) 00000020:00000080:1.0:1784936528.184687:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784936528.184783:0:5777:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007970dd55 from MGS, refs=2 00080000:01000000:1.0:1784936528.184788:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784936528.184793:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f55a2 00000100:00100000:1.0:1784936528.184892:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784936528.185008:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784936528.185014:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784936528.188613:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784936528.188627:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784936528.189336:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784936528.189547:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784936528.189552:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784936528.190572:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784936528.190580:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784936528.191161:0:5777:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784936528.191168:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784936528.191760:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936528.191764:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936528.191765:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936528.192392:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936528.192395:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936528.192397:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936528.192935:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784936528.196361:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1784936528.443267:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2451 MB/s 00000001:01000000:3.0:1784936528.692550:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3807 MB/s 00000001:01000000:2.0:1784936528.944024:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 434 MB/s 00000001:01000000:3.0:1784936529.193530:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 719 MB/s 00080000:10000000:3.0:1784936529.199653:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1784936529.211370:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784936529.211398:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784936529.211401:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1784936529.212096:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784936529.212166:0:5777:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784936529.212209:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784936529.212367:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784936529.212400:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784936529.212821:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936529.212960:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784936529.212966:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784936529.218056:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784936529.218072:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784936529.220268:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784936529.220283:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784936529.221054:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784936529.221075:0:5777:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.101@tcp' 00000020:01000004:1.0:1784936529.221078:0:5777:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784936529.221141:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.101@tcp (typ=mgc) 00000020:00000080:1.0:1784936529.221154:0:5777:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.101@tcp (00000000a1111d4b) 00000020:00000080:1.0:1784936529.221177:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784936529.221268:0:5777:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a7c5dd20@MGC192.168.204.101@tcp: add connection 192.168.204.101@tcp at head 00010000:00010000:1.0:1784936529.221423:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.101@tcp-0 is initialized 00000040:01000000:1.0:1784936529.221455:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 1 is initialized 00000100:00080000:0.0:1784936529.221599:0:5792:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1784936529.224682:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784936529.225242:0:5793:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784936529.225324:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.101@tcp (uuid b62e4f62-8046-4b06-8586-527734139351) 00000020:00000080:0.0:1784936529.225349:0:5777:0:(genops.c:1406:class_connect()) connect: client b62e4f62-8046-4b06-8586-527734139351, cookie 0x6cf7a864723f55b0 00000100:00080000:0.0:1784936529.225362:0:5777:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784936529.225369:0:5777:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import 00000000a7c5dd20 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936529.225415:0:5777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000c5c0dad x1871641524043904/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784936529.225466:0:5777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b62e4f62-8046-4b06-8586-527734139351->MGS 00000020:01000004:0.0:1784936529.225489:0:5777:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784936529.225494:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784936529.225516:0:5777:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000883aa6a9) 00000020:00000080:0.0:1784936529.225529:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784936529.231591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c5c0dad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b62e4f62-8046-4b06-8586-527734139351:3304:1871641524043904:0@lo:250: 00000100:00100000:2.0:1784936529.231690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936529.232485:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524043904 00000100:00100000:1.0:1784936529.232496:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524043904 00000100:00100000:1.0:1784936529.232906:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936529.232914:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000837e579d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1871641524043904:12345-0@lo:250: 00010000:00080000:1.0:1784936529.232963:0:5788:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b62e4f62-8046-4b06-8586-527734139351@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1784936529.233001:0:5788:0:(genops.c:1406:class_connect()) connect: client b62e4f62-8046-4b06-8586-527734139351, cookie 0x6cf7a864723f55be 00000100:00080000:1.0:1784936529.238464:0:5788:0:(import.c:65:import_set_state_nolock()) 00000000e06647e7 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936529.238614:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000837e579d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+5:3304:x1871641524043904:12345-0@lo:250: Request processed in 5698us (6922us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936529.238626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936529.240783:0:3304:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784936529.240802:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1784936529.240813:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784936529.240818:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784936529.240822:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000a7c5dd20 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784936529.240827:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784936529.240841:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784936529.240849:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c5c0dad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b62e4f62-8046-4b06-8586-527734139351:3304:1871641524043904:0@lo:250: 00000100:00100000:0.0:1784936529.262203:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936529.262859:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784936529.262937:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784936529.264028:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784936529.264038:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1784936529.264375:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784936529.264383:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784936529.265189:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936529.265367:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784936529.265372:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784936529.265968:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784936529.265975:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1784936529.336407:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784936529.336932:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784936529.336941:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784936529.338384:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784936529.338395:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784936529.344133:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784936529.344322:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784936529.344329:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784936529.344945:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784936529.344952:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784936529.345614:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784936529.345753:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784936529.345758:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784936529.346379:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784936529.346385:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784936529.346946:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784936529.347075:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784936529.347081:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784936529.354048:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784936529.354065:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784936529.398875:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784936529.400844:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784936529.400853:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784936529.402755:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784936529.402768:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784936529.407095:0:5777:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784936529.407113:0:5777:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784936529.409390:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784936529.409418:0:5777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784936529.409425:0:5777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784936529.409610:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784936529.409644:0:5777:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784936529.409648:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784936529.409650:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784936529.409651:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936529.409654:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936529.409655:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936529.409656:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936529.409657:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784936529.409658:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784936529.409659:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936529.409661:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936529.409662:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936529.409663:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936529.409665:0:5777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784936529.409667:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784936529.409668:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784936529.409669:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936529.409669:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936529.409670:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936529.409671:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936529.409672:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784936529.409672:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784936529.409673:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936529.409674:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936529.409674:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936529.409675:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936529.409710:0:5777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784936529.409728:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a60a75d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044032:0@lo:253: 00000100:00100000:2.0:1784936529.409806:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936529.409868:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000009af005b4 going to sleep for 11 seconds 00000100:00100000:1.0:1784936529.411696:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044032 00000100:00100000:1.0:1784936529.411712:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044032 00000100:00100000:1.0:1784936529.411780:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784936529.411789:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000000ed76bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+5:5777:x1871641524044032:12345-0@lo:253: 20000000:01000000:1.0:1784936529.411858:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784936529.411861:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1784936529.413682:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784936529.414212:0:5791:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1784936529.415706:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784936529.420252:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784936529.423923:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784936529.423931:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784936529.423937:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784936529.423940:0:5791:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784936529.423957:0:5791:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784936529.425213:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936529.425479:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784936529.425493:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784936529.425541:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784936529.425592:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784936529.425627:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784936529.425721:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784936529.425730:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784936529.425774:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784936529.425782:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784936529.425812:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784936529.425818:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784936529.425843:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784936529.425915:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784936529.425945:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784936529.425950:0:5791:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784936529.425960:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936529.426148:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784936529.426158:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784936529.426189:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784936529.426233:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784936529.426282:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784936529.426294:0:5791:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784936529.426365:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784936529.426373:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784936529.426414:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784936529.426476:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784936529.426511:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784936529.426522:0:5791:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784936529.426598:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784936529.426608:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784936529.426640:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784936529.426685:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784936529.426837:0:5791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784936529.426882:0:5791:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784936529.426889:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784936529.429181:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784936529.440761:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784936529.440797:0:5791:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.101@tcp for mdt 20000000:01000000:1.0:1784936529.440800:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:1.0:1784936529.440859:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784936529.440867:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784936529.440898:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784936529.440906:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:1.0:1784936529.440951:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784936529.440962:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784936529.440994:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784936529.441029:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784936529.441592:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784936529.441597:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784936529.441600:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784936529.441612:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784936529.441615:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784936529.441644:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784936529.441647:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784936529.442690:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1784936529.443712:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1784936529.443765:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1784936529.443798:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1784936529.443814:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784936529.443817:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784936529.446672:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1784936529.447025:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1784936529.447105:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1784936529.447459:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1784936529.447481:0:5791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784936529.447484:0:5791:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1784936529.447490:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784936529.447492:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784936529.447499:0:5791:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784936529.447506:0:5791:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784936529.449672:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1784936529.449973:0:5791:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784936529.485962:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1784936529.486020:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784936529.486122:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784936529.486158:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784936529.486184:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.486204:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509868:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509886:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509892:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509899:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509904:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066df5e37 already unused, calling callback (00000000476de449) 00010000:00010000:3.0:1784936529.509907:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509914:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509943:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509952:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.509958:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784936529.510008:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784936529.786653:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000000ed76bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+5:5777:x1871641524044032:12345-0@lo:253: Request processed in 374855us (376838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936529.786675:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784936529.789536:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a60a75d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044032:0@lo:253: 10000000:01000000:1.0:1784936529.789560:0:5777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784936529.789564:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784936529.789566:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784936529.789568:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784936529.789569:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1784936529.789570:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784936529.789572:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784936529.789573:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784936529.789575:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784936529.789576:0:5777:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784936529.789578:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784936529.789580:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784936529.789794:0:5777:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007970dd55 from lustre-MDT0000 10000000:01000000:1.0:1784936529.789821:0:5777:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784936529.789824:0:5777:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784936529.789829:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9096c8a88000 10000000:01000000:1.0:1784936529.789846:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784936529.789855:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9096c8a88000 from 1 10000000:01000000:1.0:1784936529.789858:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784936529.789915:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.789926:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.789934:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936529.789952:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044160:0@lo:101: 00000100:00100000:1.0:1784936529.790515:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936529.790581:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b14c4b2e going to sleep for 11 seconds 00000100:00100000:0.0:1784936529.790877:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044160 00000100:00100000:0.0:1784936529.790886:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044160 00000100:00100000:0.0:1784936529.790935:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936529.790943:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c833f582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+5:5777:x1871641524044160:12345-0@lo:101: 00010000:00010000:0.0:1784936529.790958:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936529.790975:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000add9d581/0x6cf7a864723f55d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f55cc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936529.791000:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000add9d581/0x6cf7a864723f55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936529.791023:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000add9d581/0x6cf7a864723f55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936529.791032:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000add9d581, rc 0) 00000100:00100000:0.0:1784936529.791103:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c833f582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+6:5777:x1871641524044160:12345-0@lo:101: Request processed in 161us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936529.791110:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784936529.791459:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044160:0@lo:101: 00010000:00010000:1.0:1784936529.791479:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.791490:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936529.791554:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044288:0@lo:501: 00000100:00100000:1.0:1784936529.792127:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936529.792169:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b14c4b2e going to sleep for 11 seconds 00000100:00100000:2.0:1784936529.792260:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044288 00000100:00100000:2.0:1784936529.792266:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044288 00000100:00100000:2.0:1784936529.792309:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936529.792316:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000938626c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+6:5777:x1871641524044288:12345-0@lo:501: 00000100:00100000:2.0:1784936529.793272:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000938626c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+6:5777:x1871641524044288:12345-0@lo:501: Request processed in 952us (1684us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784936529.793284:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784936529.793410:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044288:0@lo:501: 10000000:01000000:1.0:1784936529.793479:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784936529.793500:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.793517:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000f35ff43f/0x6cf7a864723f55cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936529.793548:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9096d473e000 10000000:01000000:1.0:1784936529.793553:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784936529.793559:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9096d473e000 10000000:01000000:1.0:1784936529.793562:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784936529.793565:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9096d473e000 from 1 10000000:01000000:1.0:1784936529.793568:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784936529.794151:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.794161:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.794171:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936529.794189:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044416:0@lo:101: 00000100:00100000:1.0:1784936529.794242:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936529.794276:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b14c4b2e going to sleep for 11 seconds 00000100:00100000:3.0:1784936529.795092:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044416 00000100:00100000:3.0:1784936529.795101:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044416 00000100:00100000:3.0:1784936529.795174:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936529.795182:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000006af4b1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+6:5777:x1871641524044416:12345-0@lo:101: 00010000:00010000:3.0:1784936529.795196:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936529.795209:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f55da expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.795243:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f55da expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.795253:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066df5e37/0x6cf7a864723f55e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f55da expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.795261:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066df5e37, rc 0) 00000100:00100000:3.0:1784936529.795334:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000006af4b1c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+7:5777:x1871641524044416:12345-0@lo:101: Request processed in 152us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936529.795340:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784936529.795476:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044416:0@lo:101: 00010000:00010000:1.0:1784936529.795495:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.795503:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936529.795532:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784936529.795538:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.795545:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000b53ef4be/0x6cf7a864723f55da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936529.795552:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784936529.795556:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784936529.795561:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9096d473e000 10000000:01000000:1.0:1784936529.795563:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784936529.795566:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784936529.795569:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784936529.796142:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.796151:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.796159:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936529.796178:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044544:0@lo:101: 00000100:00100000:1.0:1784936529.796228:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936529.796268:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b14c4b2e going to sleep for 11 seconds 00000100:00100000:3.0:1784936529.797150:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044544 00000100:00100000:3.0:1784936529.797160:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044544 00000100:00100000:3.0:1784936529.797227:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784936529.797236:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005b09cc45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+7:5777:x1871641524044544:12345-0@lo:101: 00010000:00010000:3.0:1784936529.797250:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936529.797263:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000338cbc14/0x6cf7a864723f55ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f55e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.797286:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000338cbc14/0x6cf7a864723f55ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.797295:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000338cbc14/0x6cf7a864723f55ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936529.797321:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000338cbc14, rc 0) 00000100:00100000:3.0:1784936529.797380:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005b09cc45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+8:5777:x1871641524044544:12345-0@lo:101: Request processed in 145us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936529.797387:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784936529.797474:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044544:0@lo:101: 00010000:00010000:1.0:1784936529.797491:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936529.797511:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936529.797573:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044672:0@lo:501: 00000100:00100000:1.0:1784936529.797683:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936529.798083:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044672 00000100:00100000:0.0:1784936529.798095:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044672 00000100:00100000:0.0:1784936529.798134:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936529.798141:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000288b2e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+8:5777:x1871641524044672:12345-0@lo:501: 00000100:00100000:0.0:1784936529.798391:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000288b2e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+9:5777:x1871641524044672:12345-0@lo:501: Request processed in 250us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936529.798399:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784936529.798793:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b14c4b2e going to sleep for 11 seconds 00000100:00100000:1.0:1784936529.798808:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044672:0@lo:501: 00000100:00100000:1.0:1784936529.798838:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044800:0@lo:503: 00000100:00100000:1.0:1784936529.798874:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936529.799233:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b14c4b2e going to sleep for 11 seconds 00000100:00100000:2.0:1784936529.805495:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044800 00000100:00100000:2.0:1784936529.805512:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044800 00000100:00100000:2.0:1784936529.805567:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936529.805575:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000edd52c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+9:5777:x1871641524044800:12345-0@lo:503: 00000100:00100000:2.0:1784936529.805829:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000edd52c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+9:5777:x1871641524044800:12345-0@lo:503: Request processed in 253us (6954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936529.805838:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784936529.805872:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe405a9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524044800:0@lo:503: 00000100:00100000:2.0:1784936529.806125:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026d109dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5820:1871641524044928:0@lo:502: 00000100:00100000:2.0:1784936529.806168:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936529.806190:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524044928 00000100:00100000:3.0:1784936529.806195:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524044928 00000100:00100000:2.0:1784936529.806204:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0541bb9 going to sleep for 11 seconds 00000100:00100000:3.0:1784936529.806235:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936529.806242:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002a8e2bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+9:5820:x1871641524044928:12345-0@lo:502: 00000100:00100000:3.0:1784936529.810531:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002a8e2bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+9:5820:x1871641524044928:12345-0@lo:502: Request processed in 4274us (4347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936529.810551:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784936529.810864:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026d109dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5820:1871641524044928:0@lo:502: 00000020:01000000:0.0:1784936529.810909:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936529.810922:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936529.810924:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784936529.810929:0:5820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784936529.810932:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784936529.810948:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008cf9b73c) 00000020:00000080:0.0:1784936529.810969:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784936529.810974:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784936529.811058:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784936529.811076:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f55fd 00000020:00000080:0.0:1784936529.811400:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784936529.811405:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936529.811409:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936529.811410:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784936529.811413:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936529.811416:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936529.811417:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784936529.811420:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784936529.811446:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005b1fa364) 00000020:00000080:0.0:1784936529.811457:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784936529.811462:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784936529.811464:0:5820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784936529.811472:0:5820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784936529.811479:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784936529.811534:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007970dd55 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784936529.811547:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c3b6be5f) 00000020:00000080:0.0:1784936529.811555:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784936529.811599:0:5820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784936529.811605:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f5612 00000020:00000080:0.0:1784936529.811717:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784936529.811724:0:5820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784936529.811729:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6cf7a864723f5619 00080000:01000000:0.0:1784936529.811733:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784936529.811736:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f5620 00080000:10000000:0.0:1784936529.812156:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1784936529.813826:0:5820:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1784936529.825071:0:5820:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1784936529.912554:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1784936529.912903:0:5820:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1784936529.920820:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1784936529.921127:0:5820:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784936529.968198:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000008b906d8) 00000020:00000080:1.0:1784936529.968235:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784936529.968305:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784936529.968313:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f562e 00000020:00000080:0.0:1784936529.968848:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784936529.970318:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936530.047908:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936530.108245:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936530.151186:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936530.184732:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936530.224484:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1784936530.252333:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784936530.262330:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6cf7a864723f5635 00000020:00000080:1.0:1784936530.263842:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784936530.263857:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936530.263865:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936530.263868:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784936530.263872:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936530.263877:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936530.263878:0:5820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784936530.263893:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784936530.263894:0:5820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784936530.263897:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936530.263899:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936530.263900:0:5820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784936530.263902:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936530.263907:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936530.263908:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784936530.263912:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784936530.263955:0:5820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1784936530.264013:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8c419ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5820:1871641524045056:0@lo:502: 00000100:00100000:1.0:1784936530.264170:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936530.264274:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000002421de0b going to sleep for 11 seconds 00000100:00100000:3.0:1784936530.264353:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045056 00000100:00100000:3.0:1784936530.264360:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045056 00000100:00100000:3.0:1784936530.264473:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784936530.264482:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f1477ae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+9:5820:x1871641524045056:12345-0@lo:502: 00000100:00100000:3.0:1784936530.264907:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f1477ae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+9:5820:x1871641524045056:12345-0@lo:502: Request processed in 425us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936530.264915:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784936530.265043:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8c419ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5820:1871641524045056:0@lo:502: 00000020:01000000:1.0:1784936530.265072:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936530.265078:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936530.265080:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1784936530.265084:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1784936530.265326:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1784936530.265347:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784936530.265370:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.265380:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 0000000013a1055f/0x6cf7a864723f55e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936530.265395:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096d473e000 from 1 10000000:01000000:2.0:1784936530.265398:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784936530.265454:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.265462:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.265472:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936530.265487:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045184:0@lo:101: 00000100:00100000:2.0:1784936530.265521:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.265983:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000937d5dc1 going to sleep for 11 seconds 00000100:00100000:0.0:1784936530.266034:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045184 00000100:00100000:0.0:1784936530.266041:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045184 00000100:00100000:1.0:1784936530.266150:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784936530.266161:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000061be8a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+9:5777:x1871641524045184:12345-0@lo:101: 00010000:00010000:1.0:1784936530.266173:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936530.266188:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f563c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936530.266223:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f563c expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936530.266234:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f563c expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936530.266255:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000438b4580, rc 0) 00000100:00100000:1.0:1784936530.266306:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000061be8a0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+10:5777:x1871641524045184:12345-0@lo:101: Request processed in 148us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936530.266312:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784936530.266421:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045184:0@lo:101: 00010000:00010000:2.0:1784936530.266472:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.266481:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936530.267239:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045312:0@lo:256: 00000100:00100000:2.0:1784936530.267289:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.267328:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000937d5dc1 going to sleep for 11 seconds 00000100:00100000:1.0:1784936530.267687:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045312 00000100:00100000:1.0:1784936530.267694:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045312 00000100:00100000:1.0:1784936530.267787:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784936530.267795:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f23ccb3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+10:5777:x1871641524045312:12345-0@lo:256: 20000000:01000000:1.0:1784936530.267816:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784936530.267822:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784936530.267894:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f23ccb3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+10:5777:x1871641524045312:12345-0@lo:256: Request processed in 100us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936530.267902:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784936530.268122:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045312:0@lo:256: 10000000:01000000:2.0:1784936530.268962:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784936530.268981:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.269000:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936530.269007:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096d473e000 from 1 10000000:01000000:2.0:1784936530.269010:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784936530.269196:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.269214:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.269224:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936530.269241:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045440:0@lo:101: 00000100:00100000:2.0:1784936530.269286:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.269367:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000937d5dc1 going to sleep for 11 seconds 00000100:00100000:0.0:1784936530.269574:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045440 00000100:00100000:0.0:1784936530.269656:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045440 00000100:00100000:0.0:1784936530.269692:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936530.269699:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000028368258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+10:5777:x1871641524045440:12345-0@lo:101: 00010000:00010000:0.0:1784936530.269712:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936530.269726:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f564a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.269837:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f564a expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.269849:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f564a expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.269858:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c047aa8, rc 0) 00000100:00100000:0.0:1784936530.269955:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000028368258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524045440:12345-0@lo:101: Request processed in 256us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936530.269963:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784936530.270353:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045440:0@lo:101: 00010000:00010000:2.0:1784936530.270369:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.270378:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936530.270710:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045568:0@lo:501: 00000100:00100000:2.0:1784936530.270746:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.270890:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000937d5dc1 going to sleep for 11 seconds 00000100:00100000:0.0:1784936530.270944:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045568 00000100:00100000:0.0:1784936530.270950:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045568 00000100:00100000:0.0:1784936530.271020:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784936530.271100:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000043e033bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524045568:12345-0@lo:501: 00000100:00100000:0.0:1784936530.272526:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000043e033bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524045568:12345-0@lo:501: Request processed in 1425us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936530.272538:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784936530.273819:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045568:0@lo:501: 00000100:00100000:2.0:1784936530.273882:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045696:0@lo:503: 00000100:00100000:2.0:1784936530.274528:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.274573:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000937d5dc1 going to sleep for 11 seconds 00000100:00100000:0.0:1784936530.274863:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045696 00000100:00100000:0.0:1784936530.274870:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045696 00000100:00100000:0.0:1784936530.274929:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784936530.274937:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000008d0e5cee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524045696:12345-0@lo:503: 00000040:00080000:0.0:1784936530.274989:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784936530.275222:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000008d0e5cee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524045696:12345-0@lo:503: Request processed in 285us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936530.275231:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784936530.275343:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045696:0@lo:503: 00000040:00080000:0.0:1784936530.277864:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784936530.280551:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784936530.280571:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784936530.280695:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.280710:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936530.280760:0:5777:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784936530.280763:0:5777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9096d473e000 10000000:01000000:2.0:1784936530.280766:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9096d473e000 10000000:01000000:2.0:1784936530.280770:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784936530.280775:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096d473e000 from 1 10000000:01000000:2.0:1784936530.280778:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784936530.280817:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.280825:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.280835:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936530.280858:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045824:0@lo:101: 00000100:00100000:2.0:1784936530.280943:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.280993:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000009af005b4 going to sleep for 11 seconds 00000100:00100000:0.0:1784936530.281128:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045824 00000100:00100000:0.0:1784936530.281142:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045824 00000100:00100000:0.0:1784936530.281200:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784936530.281221:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000049ad1541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524045824:12345-0@lo:101: 00010000:00010000:0.0:1784936530.281236:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936530.281251:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096ab26ad/0x6cf7a864723f565f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5658 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.281275:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096ab26ad/0x6cf7a864723f565f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.281285:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096ab26ad/0x6cf7a864723f565f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.281294:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096ab26ad, rc 0) 00000100:00100000:0.0:1784936530.281351:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000049ad1541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5777:x1871641524045824:12345-0@lo:101: Request processed in 133us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936530.281358:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784936530.281472:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000987e8956 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045824:0@lo:101: 00010000:00010000:3.0:1784936530.281489:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936530.281498:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936530.281569:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045952:0@lo:501: 00000100:00100000:3.0:1784936530.281712:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936530.281738:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000597050d9 going to sleep for 11 seconds 00000100:00100000:0.0:1784936530.281777:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524045952 00000100:00100000:0.0:1784936530.281781:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524045952 00000100:00100000:0.0:1784936530.281808:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784936530.281813:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000022e1a096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:5777:x1871641524045952:12345-0@lo:501: 00000100:00100000:0.0:1784936530.282114:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000022e1a096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:5777:x1871641524045952:12345-0@lo:501: Request processed in 300us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936530.282121:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784936530.282181:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524045952:0@lo:501: 00000100:00100000:3.0:1784936530.282220:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524046080:0@lo:503: 00000100:00100000:3.0:1784936530.282253:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936530.282273:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000597050d9 going to sleep for 11 seconds 00000100:00100000:2.0:1784936530.282331:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046080 00000100:00100000:2.0:1784936530.282335:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046080 00000100:00100000:2.0:1784936530.282366:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784936530.282372:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a2b73a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5777:x1871641524046080:12345-0@lo:503: 00000100:00100000:2.0:1784936530.282766:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a2b73a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5777:x1871641524046080:12345-0@lo:503: Request processed in 393us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936530.282773:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784936530.282963:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524046080:0@lo:503: 00000100:00100000:3.0:1784936530.283751:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5825:1871641524046208:0@lo:502: 00000100:00100000:3.0:1784936530.283808:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936530.283880:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000001995db4a going to sleep for 11 seconds 00000100:00100000:2.0:1784936530.283918:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046208 00000100:00100000:2.0:1784936530.283924:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046208 00000100:00100000:2.0:1784936530.283991:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784936530.284001:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000025ba3a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5825:x1871641524046208:12345-0@lo:502: 00000100:00100000:2.0:1784936530.284262:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000025ba3a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5825:x1871641524046208:12345-0@lo:502: Request processed in 263us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936530.284269:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784936530.284347:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5825:1871641524046208:0@lo:502: 00000020:01000004:3.0:1784936530.284405:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784936530.284448:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000be6f9fe5) 00000020:00000080:3.0:1784936530.284468:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1784936530.284817:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007970dd55 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784936530.284822:0:5825:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007970dd55 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784936530.284824:0:5825:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007970dd55 4 00010000:00080000:3.0:1784936530.284861:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000401a21ef@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:3.0:1784936530.288457:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1784936530.288561:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784936530.288610:0:5825:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784936530.288624:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6cf7a864723f566d 00000100:00080000:3.0:1784936530.288635:0:5825:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784936530.288639:0:5825:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000401a21ef using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936530.288672:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000036452165 x1871641524046336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784936530.288711:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784936530.289347:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8c419ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5825:1871641524046464:0@lo:502: 00000100:00100000:1.0:1784936530.289420:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936530.289469:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046464 00000100:00100000:1.0:1784936530.289475:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046464 00000100:00100000:1.0:1784936530.289512:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784936530.289519:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f650351b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5825:x1871641524046464:12345-0@lo:502: 00000100:00100000:1.0:1784936530.289723:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f650351b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5825:x1871641524046464:12345-0@lo:502: Request processed in 205us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936530.289731:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784936530.289836:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f82e5b50 going to sleep for 11 seconds 00000100:00100000:1.0:1784936530.289858:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8c419ef pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:5825:1871641524046464:0@lo:502: 00000040:00080000:1.0:1784936530.289883:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1784936530.290220:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524046336:0@lo:38: 00000100:00100000:0.0:1784936530.290258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784936530.290300:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784936530.290319:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784936530.290330:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.290345:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000151608ea/0x6cf7a864723f5658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784936530.290385:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784936530.290387:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784936530.290388:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936530.290389:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936530.290391:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936530.290392:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936530.290393:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784936530.290395:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784936530.290396:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784936530.290398:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784936530.290399:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936530.290400:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936530.290403:0:5777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784936530.290405:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784936530.290406:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784936530.290407:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936530.290408:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936530.290409:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936530.290410:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936530.290411:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784936530.290412:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784936530.290413:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784936530.290414:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784936530.290415:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936530.290416:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936530.290449:0:5777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784936530.290458:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000676f1702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524046592:0@lo:253: 00000100:00100000:0.0:1784936530.290498:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936530.290513:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 0000000041e363ef going to sleep for 11 seconds 00000100:00100000:1.0:1784936530.291526:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046336 00000100:00100000:1.0:1784936530.291536:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046336 00000100:00100000:1.0:1784936530.291567:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936530.291573:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ff997fa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524046336:12345-0@lo:38: 00000100:00100000:1.0:1784936530.293502:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ff997fa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524046336:12345-0@lo:38: Request processed in 1922us (3237us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784936530.293516:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936530.293933:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046592 00000100:00100000:1.0:1784936530.293942:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046592 00000100:00100000:1.0:1784936530.293987:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784936530.293994:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000cef2a4ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5777:x1871641524046592:12345-0@lo:253: 20000000:01000000:1.0:1784936530.294031:0:5788:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784936530.294043:0:5788:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784936530.298470:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784936530.298484:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000401a21ef lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784936530.298493:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784936530.298509:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036452165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524046336:0@lo:38: 20000000:01000000:1.0:1784936530.327300:0:5788:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784936530.327355:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784936530.327556:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784936530.327560:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784936530.327652:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.327670:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f563c expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.327677:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.327717:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f563c expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.327731:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f563c expref: 12 pid: 5790 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936530.327744:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c3dcf52 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871641524046720:0@lo:104: 00000100:00100000:0.0:1784936530.327809:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936530.328689:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 0000000063da9967 going to sleep for 11 seconds 00000100:00100000:2.0:1784936530.328789:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046720 00000100:00100000:2.0:1784936530.328797:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046720 00000100:00100000:2.0:1784936530.328844:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936530.328852:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005b1e3914 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:5812:x1871641524046720:12345-0@lo:104: 00010000:00010000:2.0:1784936530.328865:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.328971:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784936530.328978:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005b1e3914 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:5812:x1871641524046720:12345-0@lo:104: Request processed in 127us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936530.328986:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784936530.329036:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936530.329042:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329049:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee58116b already unused, calling callback (00000000a457458c) 10000000:00010000:2.0:1784936530.329052:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329059:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936530.329065:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936530.329071:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784936530.329111:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329118:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936530.329145:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329152:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 00000000ee58116b/0x6cf7a864723f563c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5643 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329169:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936530.329171:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936530.329173:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936530.329250:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936530.329263:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000002b1bafb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524046848:0@lo:103: 00000100:00100000:1.0:1784936530.329300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936530.329411:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046848 00000100:00100000:2.0:1784936530.329416:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046848 00010000:00010000:2.0:1784936530.329458:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f563c expref: 13 pid: 5790 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936530.329496:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936530.329503:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c419ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+13:3305:x1871641524046848:12345-0@lo:103: 00010000:00010000:2.0:1784936530.329513:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936530.329518:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f563c expref: 13 pid: 5790 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329527:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f563c expref: 13 pid: 5790 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329544:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329551:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784936530.329565:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002004481s 00010000:00010000:2.0:1784936530.329568:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329585:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329591:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329597:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329603:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d70d9aff already unused, calling callback (00000000476de449) 00010000:00010000:2.0:1784936530.329606:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329618:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329626:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936530.329635:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936530.329663:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c419ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+13:3305:x1871641524046848:12345-0@lo:103: Request processed in 162us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936530.329669:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936530.329676:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000002b1bafb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524046848:0@lo:103: 00010000:00010000:0.0:1784936530.329833:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000438b4580/0x6cf7a864723f5643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f563c expref: 12 pid: 5790 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936530.329845:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c3dcf52 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871641524046720:0@lo:104: 00010000:00010000:0.0:1784936530.329859:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.329867:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.329883:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936530.329889:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d70d9aff/0x6cf7a864723f5674 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936530.339176:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000cef2a4ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5777:x1871641524046592:12345-0@lo:253: Request processed in 45175us (48670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936530.339193:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784936530.340537:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000676f1702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:5777:1871641524046592:0@lo:253: 10000000:01000000:2.0:1784936530.340558:0:5777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784936530.340562:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784936530.340564:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784936530.340565:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936530.340567:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936530.340568:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936530.340623:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936530.340625:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784936530.340626:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784936530.340628:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936530.340629:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936530.340631:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936530.340632:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784936530.340650:0:5777:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784936530.346553:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784936530.346935:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784936530.347155:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784936530.347343:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784936530.347570:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784936530.347743:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936530.349091:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936530.349277:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936530.349522:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936530.349925:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936530.350120:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936530.350356:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1784936530.397904:0:5777:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1784936530.446993:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784936530.447897:0:5831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784936530.455960:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:2.0:1784936530.456882:0:5830:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784936530.456888:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1784936530.458332:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784936530.458874:0:5777:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784936530.458971:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784936530.459250:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784936530.460278:0:5777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784936530.460804:0:5777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784936530.460834:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784936530.461064:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784936530.462993:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1784936530.464466:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1784936530.467077:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1784936530.467325:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1784936530.467484:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1784936530.467856:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1784936530.467991:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784936530.468154:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784936530.468306:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784936530.468489:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784936530.471180:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784936530.471454:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784936530.471595:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784936530.471758:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784936530.471881:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784936530.472032:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784936530.472170:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784936530.472509:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784936530.472647:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784936530.472801:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784936530.472924:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784936530.473091:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784936530.473273:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784936530.473501:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784936530.473639:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784936530.473800:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784936530.473930:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784936530.474079:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784936530.475385:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784936530.476315:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784936530.476530:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784936530.476928:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784936530.477082:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784936530.477298:0:5777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1784936530.507039:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784936530.600539:0:5777:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784936530.600587:0:5777:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3a5c1767988 00100000:10000000:1.0:1784936530.600595:0:5777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784936530.601472:0:5777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784936530.601488:0:5777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784936530.601504:0:5777:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784936530.601527:0:5777:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1784936530.618909:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784936530.618979:0:5831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784936530.618983:0:5831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1784936531.272524:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936532.304254:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936533.323588:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936534.344539:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784936535.043966:0:6073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784936535.369445:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936535.433183:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054740265 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524046976:0@lo:400: 00000100:00100000:1.0:1784936535.433268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936535.433412:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524046976 00000100:00100000:0.0:1784936535.433421:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524046976 00000100:00100000:0.0:1784936535.433478:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784936535.433486:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000cf4bfca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:3307:x1871641524046976:12345-0@lo:400: 00000100:00080000:2.0:1784936535.433575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784936535.433581:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784936535.433583:0:37:0:(import.c:65:import_set_state_nolock()) 00000000401a21ef lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784936535.433591:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000401a21ef using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1784936535.433613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c5f9d5a9 x1871641524047104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784936535.433643:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5f9d5a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524047104:0@lo:38: 00000100:00100000:2.0:1784936535.433723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936535.436933:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054740265 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524046976:0@lo:400: 00000100:00100000:0.0:1784936535.436933:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000cf4bfca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:3307:x1871641524046976:12345-0@lo:400: Request processed in 3440us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936535.436986:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047104 00000100:00100000:1.0:1784936535.437000:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047104 00000100:00100000:1.0:1784936535.437098:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936535.437119:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784936535.437122:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000002fb9883 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1871641524047104:12345-0@lo:38: 00010000:00080000:1.0:1784936535.437154:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1784936535.437194:0:5798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6cf7a864723f567b 00000004:00100000:1.0:1784936535.437275:0:5798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784936535.437395:0:5798:0:(import.c:65:import_set_state_nolock()) 0000000030590afb : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936535.437500:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000002fb9883 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1871641524047104:12345-0@lo:38: Request processed in 378us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936535.437508:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784936535.437584:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c5f9d5a9 x1871641524047104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784936545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784936535.437605:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784936535.437614:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784936535.437619:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784936535.437621:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000401a21ef lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784936535.437626:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5f9d5a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524047104:0@lo:38: 10000000:01000000:1.0:1784936535.949773:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784936535.949783:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096d473e000 from 3 10000000:01000000:1.0:1784936535.949788:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784936535.949829:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.949843:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.949852:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936535.949876:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b40c270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524047232:0@lo:101: 00000100:00100000:1.0:1784936535.952222:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936535.952282:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aa7e985 going to sleep for 11 seconds 00000100:00100000:1.0:1784936535.952320:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047232 00000100:00100000:1.0:1784936535.952328:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047232 00000100:00100000:1.0:1784936535.952373:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784936535.952382:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000088d6666c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5793:x1871641524047232:12345-0@lo:101: 00010000:00010000:1.0:1784936535.952409:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936535.952445:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000000dcf30/0x6cf7a864723f5689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5682 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.952473:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000000dcf30/0x6cf7a864723f5689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.952484:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000000dcf30/0x6cf7a864723f5689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.952493:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000000dcf30, rc 0) 00000100:00100000:1.0:1784936535.952547:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000088d6666c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524047232:12345-0@lo:101: Request processed in 166us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936535.952553:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784936535.952599:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b40c270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524047232:0@lo:101: 00010000:00010000:1.0:1784936535.952614:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.952623:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936535.952681:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b40c270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524047360:0@lo:256: 00000100:00100000:1.0:1784936535.952718:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936535.952733:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aa7e985 going to sleep for 11 seconds 00000100:00100000:1.0:1784936535.952746:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047360 00000100:00100000:1.0:1784936535.952750:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047360 00000100:00100000:1.0:1784936535.952769:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784936535.952774:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e7574a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524047360:12345-0@lo:256: 20000000:01000000:1.0:1784936535.952794:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784936535.952807:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784936535.952810:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1784936535.952879:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e7574a6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524047360:12345-0@lo:256: Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936535.952886:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784936535.952914:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b40c270 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524047360:0@lo:256: 10000000:01000000:1.0:1784936535.952952:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784936535.952958:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936535.952965:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: 00000000e8552bc4/0x6cf7a864723f5682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936536.399733:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936537.416964:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936538.440558:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936539.469257:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784936539.794828:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7cecc000 20000000:00000080:1.0:1784936539.794847:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff909701a25c00 uarg=0000000000000000 20000000:01000000:1.0:1784936539.794879:0:6275:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784936539.794886:0:6275:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784936539.794891:0:6275:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784936539.795115:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1784936539.795127:0:6275:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1784936539.802686:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784936539.802951:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784936539.803003:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1784936539.803078:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1784936539.803095:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784936539.803112:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936539.803129:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f564a expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936539.803141:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936539.803176:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f564a expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936539.803191:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f564a expref: 11 pid: 5788 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936539.803205:0:6275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b40c270 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1871641524047488:0@lo:104: 00000100:00100000:1.0:1784936539.803268:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936539.803403:0:6275:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca6374b1 going to sleep for 11 seconds 00000100:00100000:2.0:1784936539.806647:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047488 00000100:00100000:2.0:1784936539.806660:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047488 00000100:00100000:2.0:1784936539.806762:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784936539.806772:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000091622147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:6275:x1871641524047488:12345-0@lo:104: 00010000:00010000:2.0:1784936539.806788:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936539.806898:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784936539.806904:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000091622147 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:6275:x1871641524047488:12345-0@lo:104: Request processed in 135us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936539.806911:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1784936539.806957:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936539.806963:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.806971:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004504aff4 already unused, calling callback (00000000a457458c) 10000000:00010000:3.0:1784936539.806974:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.806982:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936539.806988:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936539.806993:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784936539.807045:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807052:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936539.807069:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807075:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: 000000004504aff4/0x6cf7a864723f564a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5651 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807096:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936539.807098:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936539.807099:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936539.807134:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047cb7cdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524047616:0@lo:103: 00000100:00100000:3.0:1784936539.807173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936539.807227:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047616 00000100:00100000:3.0:1784936539.807231:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047616 00010000:00010000:3.0:1784936539.807248:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f564a expref: 12 pid: 5788 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936539.807267:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936539.807272:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000753d6ee3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+12:3308:x1871641524047616:12345-0@lo:103: 00010000:00010000:3.0:1784936539.807282:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936539.807286:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f564a expref: 12 pid: 5788 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807295:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f564a expref: 12 pid: 5788 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807312:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807320:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807333:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807340:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807345:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807361:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807367:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008c0370dc already unused, calling callback (00000000476de449) 00010000:00010000:3.0:1784936539.807370:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807376:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807384:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936539.807392:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936539.807418:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000753d6ee3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+12:3308:x1871641524047616:12345-0@lo:103: Request processed in 146us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936539.807425:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936539.807476:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047cb7cdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524047616:0@lo:103: 00010000:00010000:0.0:1784936539.809407:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c047aa8/0x6cf7a864723f5651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f564a expref: 11 pid: 5788 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936539.809456:0:6275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b40c270 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1871641524047488:0@lo:104: 00010000:00010000:0.0:1784936539.809478:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936539.809488:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936539.809493:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936539.809499:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c0370dc/0x6cf7a864723f5690 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936540.488630:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936540.557464:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047cb7cdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524047744:0@lo:400: 00000100:00100000:3.0:1784936540.557550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936540.557628:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047744 00000100:00100000:3.0:1784936540.557636:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047744 00000100:00100000:3.0:1784936540.557683:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784936540.557692:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000000c03ab82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:3305:x1871641524047744:12345-0@lo:400: 00000100:00100000:3.0:1784936540.557744:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000000c03ab82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:3305:x1871641524047744:12345-0@lo:400: Request processed in 53us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936540.557752:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784936540.557815:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047cb7cdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524047744:0@lo:400: 00000100:00100000:3.0:1784936540.557855:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047cb7cdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524047872:0@lo:400: 00000100:00100000:3.0:1784936540.557936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936540.557972:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524047872 00000100:00100000:3.0:1784936540.557977:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524047872 00000100:00100000:3.0:1784936540.558004:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784936540.558027:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000011dcdd0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524047872:12345-0@lo:400: 00000100:00100000:3.0:1784936540.558063:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000011dcdd0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524047872:12345-0@lo:400: Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936540.558069:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784936540.558100:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047cb7cdb x1871641524047872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936540.558113:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047cb7cdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524047872:0@lo:400: 00010000:00010000:3.0:1784936541.512977:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936542.536809:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936543.560684:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936544.587606:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936545.609687:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936545.683902:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c3dcf52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524048000:0@lo:400: 00000100:00100000:3.0:1784936545.683996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936545.686175:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936545.686197:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c735147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524048128:0@lo:400: 00000100:00100000:3.0:1784936545.686482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936545.686533:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048000 00000100:00100000:3.0:1784936545.686541:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048000 00000100:00100000:3.0:1784936545.686588:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784936545.686596:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000d9961e2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+11:3307:x1871641524048000:12345-0@lo:400: 00000100:00100000:3.0:1784936545.686648:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000d9961e2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+11:3307:x1871641524048000:12345-0@lo:400: Request processed in 53us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936545.686669:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784936545.686728:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048128 00000100:00100000:3.0:1784936545.686731:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c3dcf52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524048000:0@lo:400: 00000100:00100000:1.0:1784936545.686735:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048128 00000100:00100000:1.0:1784936545.686771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784936545.686779:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000047cb7cdb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524048128:12345-0@lo:400: 00000100:00100000:1.0:1784936545.686837:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000047cb7cdb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524048128:12345-0@lo:400: Request processed in 59us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936545.686854:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784936545.686902:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007c735147 x1871641524048128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936545.686926:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c735147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524048128:0@lo:400: 00000020:01000004:0.0:1784936546.152543:0:6592:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784936546.152548:0:6592:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784936546.152770:0:6592:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000de19973e 00000020:01000004:0.0:1784936546.152787:0:6592:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784936546.152799:0:6592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784936546.152824:0:6592:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000eaaca2ef) 00000020:00000080:0.0:1784936546.152839:0:6592:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784936546.167684:0:6592:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784936546.167963:0:6592:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 10000000:01000000:0.0:1784936546.184680:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936546.184685:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096d473e000 from 1 10000000:01000000:0.0:1784936546.184689:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936546.184733:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: 00000000335dd413/0x6cf7a864723f569e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.184745:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: 00000000335dd413/0x6cf7a864723f569e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.184755:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: 00000000335dd413/0x6cf7a864723f569e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.184779:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047f2a9fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524048256:0@lo:101: 00000100:00100000:0.0:1784936546.184847:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.184913:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd49f32e going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.185016:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048256 00000100:00100000:3.0:1784936546.185024:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048256 00000100:00100000:3.0:1784936546.185071:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784936546.185079:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000077916fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+11:5793:x1871641524048256:12345-0@lo:101: 00010000:00010000:3.0:1784936546.185092:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936546.185103:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001fadb720/0x6cf7a864723f56a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f569e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.185124:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001fadb720/0x6cf7a864723f56a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f569e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.185133:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001fadb720/0x6cf7a864723f56a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f569e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.185141:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001fadb720, rc 0) 00000100:00100000:3.0:1784936546.185179:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000077916fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524048256:12345-0@lo:101: Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.185185:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784936546.187542:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047f2a9fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524048256:0@lo:101: 00010000:00010000:2.0:1784936546.187579:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: 00000000335dd413/0x6cf7a864723f569e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.187612:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: 00000000335dd413/0x6cf7a864723f569e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936546.187694:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007046f2db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524048384:0@lo:501: 00000100:00100000:2.0:1784936546.187753:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.187788:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f024536a going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.188023:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048384 00000100:00100000:3.0:1784936546.188030:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048384 00000100:00100000:3.0:1784936546.188075:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784936546.188083:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e22a990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524048384:12345-0@lo:501: 00000100:00100000:3.0:1784936546.188508:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e22a990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524048384:12345-0@lo:501: Request processed in 425us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.188517:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784936546.188767:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007046f2db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524048384:0@lo:501: 00000100:00100000:3.0:1784936546.188811:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c179936d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524048512:0@lo:503: 00000100:00100000:3.0:1784936546.188851:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.188875:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ee767aec going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.188927:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048512 00000100:00100000:0.0:1784936546.188933:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048512 00000100:00100000:0.0:1784936546.188964:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784936546.188971:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001e7c2b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524048512:12345-0@lo:503: 00000100:00100000:0.0:1784936546.192868:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001e7c2b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524048512:12345-0@lo:503: Request processed in 3893us (4012us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.192886:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784936546.193079:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c179936d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524048512:0@lo:503: 00100000:10000000:1.0:1784936546.195160:0:6592:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00000100:00100000:0.0:1784936546.201783:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050b16d31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:6594:1871641524048640:0@lo:502: 00000100:00100000:0.0:1784936546.201872:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.203944:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab5f3988 going to sleep for 11 seconds 00100000:10000000:1.0:1784936546.204417:0:6592:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784936546.204485:0:6592:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784936546.204547:0:6592:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784936546.204752:0:6592:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784936546.205098:0:6592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784936546.205109:0:6592:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784936546.205129:0:6592:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6cf7a864723f56ac 00000020:01000004:1.0:1784936546.205137:0:6592:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1784936546.205157:0:6592:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784936546.205160:0:6592:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784936546.205166:0:6592:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784936546.205170:0:6592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1784936546.205180:0:6592:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000d5a99d6c) 00000020:00000080:1.0:1784936546.205190:0:6592:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1784936546.205662:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048640 00000100:00100000:3.0:1784936546.205672:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048640 00000100:00100000:3.0:1784936546.205725:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784936546.205734:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007e37cf47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6594:x1871641524048640:12345-0@lo:502: 00000100:00100000:3.0:1784936546.205995:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007e37cf47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6594:x1871641524048640:12345-0@lo:502: Request processed in 261us (4122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.206002:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784936546.206067:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050b16d31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:6594:1871641524048640:0@lo:502: 00000020:01000000:3.0:1784936546.206098:0:6594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936546.206106:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936546.206108:0:6594:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784936546.206116:0:6594:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096d473e000 00000020:00000080:3.0:1784936546.206118:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784936546.206226:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:6594:1871641524048768:0@lo:502: 00000100:00100000:3.0:1784936546.206266:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.206290:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048768 00000100:00100000:3.0:1784936546.206294:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048768 00000100:00100000:3.0:1784936546.206315:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784936546.206328:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:6594:x1871641524048768:12345-0@lo:502: 00000100:00100000:3.0:1784936546.206454:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:6594:x1871641524048768:12345-0@lo:502: Request processed in 125us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.206460:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784936546.206499:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c999b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.206511:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:6594:1871641524048768:0@lo:502: 00000020:01000000:3.0:1784936546.206528:0:6594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936546.206532:0:6594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936546.206533:0:6594:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784936546.206537:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1784936546.206616:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784936546.207679:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784936546.207692:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.207705:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936546.207988:0:6592:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784936546.208146:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1784936546.208151:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784936546.215527:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784936546.215544:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784936546.216203:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784936546.216209:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784936546.217844:0:6592:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936546.218036:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784936546.218042:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784936546.221101:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784936546.221116:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784936546.266740:0:6592:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784936546.267033:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784936546.267040:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784936546.270421:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784936546.273331:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784936546.275149:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784936546.275163:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784936546.282588:0:6592:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784936546.282797:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784936546.282804:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784936546.284103:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784936546.284115:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784936546.381917:0:6592:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936546.382155:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784936546.382161:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784936546.383790:0:6592:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784936546.383800:0:6592:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784936546.384346:0:6592:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784936546.384371:0:6592:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784936546.384378:0:6592:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784936546.439927:0:6592:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784936546.439961:0:6592:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784936546.439965:0:6592:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784936546.439966:0:6592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936546.439968:0:6592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936546.439969:0:6592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936546.439970:0:6592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936546.439972:0:6592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936546.439973:0:6592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936546.439974:0:6592:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936546.439975:0:6592:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936546.439977:0:6592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936546.439978:0:6592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936546.439981:0:6592:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784936546.439983:0:6592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784936546.439984:0:6592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936546.439985:0:6592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936546.439986:0:6592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936546.439987:0:6592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936546.439988:0:6592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936546.439989:0:6592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936546.439990:0:6592:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936546.439991:0:6592:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936546.439992:0:6592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936546.439993:0:6592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936546.440017:0:6592:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784936546.440032:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524048896:0@lo:253: 00000100:00100000:2.0:1784936546.440380:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.440512:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c545d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.443989:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524048896 00000100:00100000:3.0:1784936546.444322:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524048896 00000100:00100000:2.0:1784936546.450445:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784936546.450459:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524048896:12345-0@lo:253: 20000000:01000000:2.0:1784936546.450524:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784936546.450528:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1784936546.450533:0:5788:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1784936546.450536:0:5788:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1784936546.454364:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784936546.455763:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1784936546.455787:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1784936546.455845:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1784936546.455853:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1784936546.455880:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1784936546.456323:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1784936546.457819:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784936546.457850:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:3.0:1784936546.457852:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:3.0:1784936546.457887:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784936546.457907:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784936546.457955:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784936546.457963:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:3.0:1784936546.457994:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784936546.458004:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784936546.458062:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784936546.458126:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1784936546.458780:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1784936546.458796:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:3.0:1784936546.458797:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:3.0:1784936546.458830:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1784936546.458837:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784936546.458867:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1784936546.458873:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:3.0:1784936546.458930:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1784936546.458938:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784936546.458966:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1784936546.458995:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1784936546.459010:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784936546.459013:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784936546.459017:0:5788:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784936546.459028:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784936546.459031:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784936546.459064:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784936546.459066:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784936546.460100:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1784936546.460571:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1784936546.460650:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1784936546.460721:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1784936546.460735:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784936546.460738:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784936546.461740:0:6609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1784936546.461801:0:6609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1784936546.461850:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1784936546.462351:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1784936546.462395:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1784936546.462490:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1784936546.462502:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784936546.462505:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784936546.463353:0:6610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1784936546.463534:0:6610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1784936546.463602:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1784936546.464060:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1784936546.464106:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1784936546.464163:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1784936546.464190:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1784936546.464192:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1784936546.464201:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784936546.464219:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464236:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464245:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464251:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464259:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464296:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464312:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 12 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.464326:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5788:1871641524049024:0@lo:104: 00000100:00100000:3.0:1784936546.464396:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784936546.464619:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464644:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 12 pid: 5791 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.464665:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2fa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5788:1871641524049152:0@lo:104: 00000100:00100000:3.0:1784936546.464689:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784936546.464764:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.464772:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 12 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.464780:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5788:1871641524049280:0@lo:104: 00000100:00100000:3.0:1784936546.464800:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.465655:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784936546.465727:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049024 00000100:00100000:1.0:1784936546.465736:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049024 00000100:00100000:1.0:1784936546.465781:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049152 00000100:00100000:1.0:1784936546.465784:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049152 00000100:00100000:1.0:1784936546.465796:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049280 00000100:00100000:1.0:1784936546.465810:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049280 00000100:00100000:1.0:1784936546.465828:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784936546.465837:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+5:5788:x1871641524049024:12345-0@lo:104: 00010000:00010000:1.0:1784936546.465851:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.465933:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784936546.465940:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+5:5788:x1871641524049024:12345-0@lo:104: Request processed in 105us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.465947:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784936546.465963:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784936546.465969:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+4:5788:x1871641524049152:12345-0@lo:104: 00010000:00010000:1.0:1784936546.465976:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466009:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784936546.466014:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+4:5788:x1871641524049152:12345-0@lo:104: Request processed in 46us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.466019:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784936546.466033:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784936546.466040:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:5788:x1871641524049280:12345-0@lo:104: 00010000:00010000:1.0:1784936546.466058:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466094:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784936546.466099:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:5788:x1871641524049280:12345-0@lo:104: Request processed in 61us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.466104:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784936546.466127:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784936546.466132:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466140:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165a400 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936546.466145:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466153:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936546.466161:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936546.466167:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784936546.466195:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466201:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936546.466215:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466221:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c165a400/0x6cf7a864723f5658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f565f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466235:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784936546.466238:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466244:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fc600 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936546.466246:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466259:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936546.466266:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936546.466271:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784936546.466284:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466290:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936546.466296:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466303:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fc600/0x6cf7a864723f55e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f55ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466313:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936546.466315:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466321:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fdc00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936546.466325:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466331:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936546.466337:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936546.466348:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784936546.466361:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466367:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936546.466381:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466387:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fdc00/0x6cf7a864723f55cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f55d3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.466595:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936546.466598:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936546.466599:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936546.466607:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784936546.466620:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524049664:0@lo:103: 00000100:00100000:1.0:1784936546.466654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784936546.466733:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936546.466964:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524049408:0@lo:103: 00000100:00100000:3.0:1784936546.466993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.467021:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936546.467027:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524049536:0@lo:103: 00000100:00100000:3.0:1784936546.467086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.467126:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049664 00000100:00100000:3.0:1784936546.467131:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049664 00010000:00010000:3.0:1784936546.467154:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.467170:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049408 00000100:00100000:3.0:1784936546.467172:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049408 00010000:00010000:3.0:1784936546.467181:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 14 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.467189:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049536 00000100:00100000:3.0:1784936546.467191:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049536 00010000:00010000:3.0:1784936546.467209:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 15 pid: 5791 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.467224:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936546.467230:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+15:3308:x1871641524049664:12345-0@lo:103: 00010000:00010000:3.0:1784936546.467241:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936546.467246:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 15 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467255:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 15 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467271:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936546.467303:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+15:3308:x1871641524049664:12345-0@lo:103: Request processed in 72us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.467309:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936546.467323:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936546.467329:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+14:3305:x1871641524049408:12345-0@lo:103: 00010000:00010000:3.0:1784936546.467336:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936546.467339:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 14 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467348:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 14 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467357:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936546.467381:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+14:3305:x1871641524049408:12345-0@lo:103: Request processed in 52us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.467386:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936546.467417:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936546.467423:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+13:3305:x1871641524049536:12345-0@lo:103: 00010000:00010000:3.0:1784936546.467450:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936546.467455:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 13 pid: 5791 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467463:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 13 pid: 5791 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467474:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467483:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467497:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467505:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467512:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467519:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467525:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4e00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936546.467529:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467538:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467553:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.467563:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936546.467586:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+13:3305:x1871641524049536:12345-0@lo:103: Request processed in 163us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.467591:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936546.467930:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524049664:0@lo:103: 00000100:00100000:3.0:1784936546.467962:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524049536:0@lo:103: 00000100:00100000:3.0:1784936546.467969:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524049408:0@lo:103: 00010000:00010000:3.0:1784936546.467996:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f565f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5658 expref: 12 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.468007:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5788:1871641524049024:0@lo:104: 00010000:00010000:3.0:1784936546.468018:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f55ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f55e8 expref: 11 pid: 5791 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.468026:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2fa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5788:1871641524049152:0@lo:104: 00010000:00010000:3.0:1784936546.468034:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031600/0x6cf7a864723f55d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f55cc expref: 10 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.468053:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5788:1871641524049280:0@lo:104: 00010000:00010000:3.0:1784936546.468070:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.468132:0:5788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.468145:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.468152:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f56ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784936546.468166:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784936546.582638:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+9:6592:x1871641524048896:12345-0@lo:253: Request processed in 132171us (142248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.582654:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784936546.586392:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524048896:0@lo:253: 10000000:01000000:2.0:1784936546.587154:0:6592:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784936546.587158:0:6592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784936546.587160:0:6592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936546.587162:0:6592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936546.587163:0:6592:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1784936546.587165:0:6592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936546.587166:0:6592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936546.587168:0:6592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936546.587169:0:6592:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784936546.587170:0:6592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936546.587171:0:6592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784936546.587382:0:6592:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9096f4d33000 from lustre-OST0000 10000000:01000000:3.0:1784936546.587491:0:6592:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784936546.587494:0:6592:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784936546.587501:0:6592:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9096c8a88000 local copy 10000000:01000000:3.0:1784936546.587505:0:6592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784936546.587543:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.587554:0:6592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.587564:0:6592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936546.587583:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524049792:0@lo:101: 00000100:00100000:3.0:1784936546.587645:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.587744:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0254600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.589788:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049792 00000100:00100000:0.0:1784936546.589800:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049792 00000100:00100000:1.0:1784936546.589981:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784936546.589992:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+9:6592:x1871641524049792:12345-0@lo:101: 00010000:00010000:1.0:1784936546.590016:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936546.590037:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c13fdc00/0x6cf7a864723f56c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f56c1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.590071:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fdc00/0x6cf7a864723f56c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f56c1 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.590100:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c13fdc00/0x6cf7a864723f56c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f56c1 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.590110:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fdc00, rc 0) 00000100:00100000:1.0:1784936546.590185:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+10:6592:x1871641524049792:12345-0@lo:101: Request processed in 194us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.590192:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784936546.590281:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524049792:0@lo:101: 00010000:00010000:0.0:1784936546.590300:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.590310:0:6592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.590457:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524049920:0@lo:501: 00000100:00100000:0.0:1784936546.590488:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.590849:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ec600 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.590940:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524049920 00000100:00100000:3.0:1784936546.590946:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524049920 00000100:00100000:3.0:1784936546.590977:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784936546.590984:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+10:6592:x1871641524049920:12345-0@lo:501: 00000100:00100000:0.0:1784936546.591396:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524049920:0@lo:501: 10000000:01000000:0.0:1784936546.591448:0:6592:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784936546.591474:0:6592:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784936546.591480:0:6592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.591489:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.591498:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.591516:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784936546.591535:0:6592:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9096f4d33000 10000000:01000000:0.0:1784936546.591539:0:6592:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784936546.591543:0:6592:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9096c8a88000 10000000:01000000:0.0:1784936546.591545:0:6592:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1784936546.591549:0:6592:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9096c8a88000 from 1 10000000:01000000:0.0:1784936546.591551:0:6592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784936546.591582:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.591590:0:6592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.591599:0:6592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.591611:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050048:0@lo:101: 00000100:00100000:0.0:1784936546.591637:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.591658:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.591963:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+10:6592:x1871641524049920:12345-0@lo:501: Request processed in 280us (775us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784936546.591980:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784936546.592109:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050048 00000100:00100000:3.0:1784936546.592114:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050048 00000100:00100000:3.0:1784936546.592139:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784936546.592145:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+10:6592:x1871641524050048:12345-0@lo:101: 00010000:00010000:3.0:1784936546.592154:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936546.592165:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f56d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f56cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.592183:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f56d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f56cf expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.592193:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f56d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f56cf expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.592201:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5a00, rc 0) 00000100:00100000:3.0:1784936546.592236:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+11:6592:x1871641524050048:12345-0@lo:101: Request processed in 91us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.592242:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784936546.592385:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050048:0@lo:101: 00010000:00010000:0.0:1784936546.592396:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.592501:0:6592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936546.592518:0:6592:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784936546.592525:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.592532:0:6592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936546.592539:0:6592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784936546.592543:0:6592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784936546.592547:0:6592:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784936546.592549:0:6592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784936546.592562:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.592569:0:6592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.592577:0:6592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.592589:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050176:0@lo:101: 00000100:00100000:0.0:1784936546.592613:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.592638:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.592699:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050176 00000100:00100000:3.0:1784936546.592703:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050176 00000100:00100000:3.0:1784936546.592720:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784936546.592725:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+11:6592:x1871641524050176:12345-0@lo:101: 00010000:00010000:3.0:1784936546.592732:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936546.592739:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f56dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.592751:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.592764:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.592770:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4800, rc 0) 00000100:00100000:3.0:1784936546.592804:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050176:12345-0@lo:101: Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.592809:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784936546.592874:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050176:0@lo:101: 00010000:00010000:0.0:1784936546.592884:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.592903:0:6592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.592979:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050304:0@lo:501: 00000100:00100000:0.0:1784936546.593251:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.593339:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.593391:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050304 00000100:00100000:3.0:1784936546.593395:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050304 00000100:00100000:3.0:1784936546.593504:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784936546.593510:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050304:12345-0@lo:501: 00000100:00100000:3.0:1784936546.593706:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050304:12345-0@lo:501: Request processed in 196us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.593713:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784936546.593821:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050304:0@lo:501: 00000100:00100000:0.0:1784936546.593849:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050432:0@lo:503: 00000100:00100000:0.0:1784936546.593884:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.593921:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936546.594008:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050432 00000100:00100000:1.0:1784936546.594013:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050432 00000100:00100000:1.0:1784936546.594037:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784936546.594395:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050432:12345-0@lo:503: 00000100:00100000:1.0:1784936546.594588:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050432:12345-0@lo:503: Request processed in 197us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.594594:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1784936546.594625:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936546.594632:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.594640:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4e00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936546.594644:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.594652:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936546.594658:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936546.594673:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784936546.594694:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.594699:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936546.594712:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.594719:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f56c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6cf7a864723f56c8 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.594731:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936546.594733:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936546.594734:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936546.598885:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050432:0@lo:503: 00000040:00080000:0.0:1784936546.599281:0:6592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784936546.599379:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050688:0@lo:502: 00000100:00100000:0.0:1784936546.599491:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.599529:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936546.599756:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050688 00000100:00100000:1.0:1784936546.599764:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050688 00000100:00100000:1.0:1784936546.599805:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784936546.599814:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050688:12345-0@lo:502: 00000100:00100000:1.0:1784936546.600018:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050688:12345-0@lo:502: Request processed in 203us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.600026:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784936546.600328:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050688:0@lo:502: 00000100:00100000:3.0:1784936546.603330:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524050560:0@lo:103: 00000100:00100000:3.0:1784936546.603420:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.603721:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050560 00000100:00100000:0.0:1784936546.603730:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050560 00000100:00100000:0.0:1784936546.603788:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936546.603798:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+12:3308:x1871641524050560:12345-0@lo:103: 00010000:00010000:0.0:1784936546.603813:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936546.603845:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fdc00/0x6cf7a864723f56c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f56c1 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.603862:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936546.603909:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+11:3308:x1871641524050560:12345-0@lo:103: Request processed in 112us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.603916:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784936546.605259:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524050560:0@lo:103: 00000040:00080000:1.0:1784936546.609691:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784936546.609805:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784936546.609850:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784936546.609918:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784936546.609957:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784936546.609987:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784936546.610196:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050816:0@lo:502: 00000100:00100000:1.0:1784936546.610352:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936546.610491:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.615555:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050816 00000100:00100000:3.0:1784936546.615571:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050816 00000100:00100000:3.0:1784936546.615641:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784936546.615651:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:6592:x1871641524050816:12345-0@lo:502: 00000100:00100000:3.0:1784936546.615941:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:6592:x1871641524050816:12345-0@lo:502: Request processed in 291us (5588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.615949:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784936546.620723:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050816:0@lo:502: 00000040:00080000:2.0:1784936546.620938:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784936546.620954:0:6592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1784936546.623369:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784936546.623381:0:6613:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1784936546.623388:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936546.623695:0:6613:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784936546.623769:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784936546.623792:0:6613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9096d0c019c0) 00000020:00000080:3.0:1784936546.623816:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784936546.623824:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784936546.623902:0:6613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096f4d33000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784936546.623912:0:6613:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784936546.623919:0:6613:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6cf7a864723f56f2 00010000:00010000:3.0:1784936546.629656:0:6613:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1784936546.630199:0:6613:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00010000:00010000:0.0:1784936546.632624:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784936546.634636:0:6613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784936546.634954:0:6613:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784936546.651705:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784936546.658733:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784936546.661307:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784936546.661319:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784936546.661326:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936546.661328:0:6613:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784936546.661332:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784936546.661336:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936546.661338:0:6613:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784936546.661340:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784936546.661343:0:6613:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784936546.661409:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784936546.661413:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936546.661415:0:6613:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784936546.661418:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784936546.661690:0:6592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1784936546.661719:0:6592:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784936546.661746:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.661758:0:6592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936546.661766:0:6592:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096f4d33000 from 1 10000000:01000000:0.0:1784936546.661769:0:6592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936546.661811:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.661818:0:6592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.661831:0:6592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.661853:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050944:0@lo:101: 00000100:00100000:0.0:1784936546.661934:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.661986:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936546.662373:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524050944 00000100:00100000:2.0:1784936546.662381:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524050944 00000100:00100000:2.0:1784936546.662496:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784936546.662507:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:6592:x1871641524050944:12345-0@lo:101: 00010000:00010000:2.0:1784936546.662520:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936546.662534:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f56f9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.662558:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.662569:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.662577:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b600, rc 0) 00000100:00100000:2.0:1784936546.662716:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524050944:12345-0@lo:101: Request processed in 210us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936546.662722:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784936546.667677:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524050944:0@lo:101: 00010000:00010000:0.0:1784936546.667709:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.667723:0:6592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.667863:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051072:0@lo:501: 00000100:00100000:0.0:1784936546.667937:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.667988:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ece40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.668134:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051072 00000100:00100000:3.0:1784936546.668141:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051072 00000100:00100000:3.0:1784936546.668189:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784936546.668199:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051072:12345-0@lo:501: 00000100:00100000:3.0:1784936546.668518:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051072:12345-0@lo:501: Request processed in 319us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.668526:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784936546.668790:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051072:0@lo:501: 00000100:00100000:0.0:1784936546.668823:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051200:0@lo:503: 00000100:00100000:0.0:1784936546.668862:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.668905:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ece40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.668924:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051200 00000100:00100000:0.0:1784936546.668928:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051200 00000100:00100000:0.0:1784936546.668957:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784936546.668965:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051200:12345-0@lo:503: 00000100:00100000:0.0:1784936546.669181:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051200:12345-0@lo:503: Request processed in 216us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.669188:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784936546.669225:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051200:0@lo:503: 00000040:00080000:0.0:1784936546.669674:0:6592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784936546.669734:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051328:0@lo:502: 00000100:00100000:0.0:1784936546.669771:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.669791:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ece40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.669813:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051328 00000100:00100000:0.0:1784936546.669817:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051328 00000100:00100000:0.0:1784936546.669838:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784936546.669844:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051328:12345-0@lo:502: 00000100:00100000:0.0:1784936546.669998:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051328:12345-0@lo:502: Request processed in 153us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.670005:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784936546.670222:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051328:0@lo:502: 00000040:00080000:0.0:1784936546.671672:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784936546.671744:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784936546.671782:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051456:0@lo:502: 00000100:00100000:0.0:1784936546.671838:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936546.671873:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ece40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.671908:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051456 00000100:00100000:0.0:1784936546.671914:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051456 00000100:00100000:0.0:1784936546.671989:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784936546.671998:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051456:12345-0@lo:502: 00000100:00100000:0.0:1784936546.673359:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051456:12345-0@lo:502: Request processed in 1357us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.673371:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784936546.676709:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051456:0@lo:502: 00000040:00080000:0.0:1784936546.676927:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784936546.676946:0:6592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784936546.680808:0:6617:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936546.680821:0:6617:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936546.680823:0:6617:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784936546.680830:0:6617:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096f4d33000 00000020:00000080:0.0:1784936546.680842:0:6617:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784936546.680865:0:6617:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936546.680869:0:6617:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936546.680870:0:6617:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784936546.680873:0:6617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784936546.681010:0:6592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784936546.681032:0:6592:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784936546.681058:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.681069:0:6592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936546.681113:0:6592:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784936546.681116:0:6592:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9096f4d33000 10000000:01000000:2.0:1784936546.681120:0:6592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9096f4d33000 10000000:01000000:2.0:1784936546.681123:0:6592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784936546.681129:0:6592:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096f4d33000 from 1 10000000:01000000:2.0:1784936546.681132:0:6592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784936546.681170:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.681178:0:6592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.681189:0:6592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936546.681212:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051584:0@lo:101: 00000100:00100000:2.0:1784936546.681799:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.681839:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849540 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.681904:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051584 00000100:00100000:3.0:1784936546.681912:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051584 00000100:00100000:3.0:1784936546.681950:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784936546.681958:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524051584:12345-0@lo:101: 00010000:00010000:3.0:1784936546.681973:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936546.681988:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5707 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.682013:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.682048:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936546.682058:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4600, rc 0) 00000100:00100000:3.0:1784936546.682110:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051584:12345-0@lo:101: Request processed in 153us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.682118:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784936546.682300:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051584:0@lo:101: 00010000:00010000:2.0:1784936546.682315:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.682334:0:6592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936546.682595:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051712:0@lo:501: 00000100:00100000:2.0:1784936546.682626:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.682646:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849540 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.682704:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051712 00000100:00100000:3.0:1784936546.682709:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051712 00000100:00100000:3.0:1784936546.682730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784936546.682735:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051712:12345-0@lo:501: 00000100:00100000:3.0:1784936546.682966:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051712:12345-0@lo:501: Request processed in 229us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.682973:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784936546.683136:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051712:0@lo:501: 00000100:00100000:2.0:1784936546.683164:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051840:0@lo:503: 00000100:00100000:2.0:1784936546.683202:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.683229:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849540 going to sleep for 11 seconds 00000100:00100000:3.0:1784936546.683274:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051840 00000100:00100000:3.0:1784936546.683279:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051840 00000100:00100000:3.0:1784936546.683308:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784936546.683314:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051840:12345-0@lo:503: 00000100:00100000:3.0:1784936546.684231:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051840:12345-0@lo:503: Request processed in 912us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.684240:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784936546.684334:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051840:0@lo:503: 00000040:00080000:2.0:1784936546.684659:0:6592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784936546.684728:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051968:0@lo:502: 00000100:00100000:2.0:1784936546.684768:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.684800:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849540 going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.685008:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524051968 00000100:00100000:0.0:1784936546.685015:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524051968 00000100:00100000:0.0:1784936546.685061:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784936546.685069:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051968:12345-0@lo:502: 00000100:00100000:0.0:1784936546.685268:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524051968:12345-0@lo:502: Request processed in 190us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.685275:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784936546.685667:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524051968:0@lo:502: 00000040:00080000:2.0:1784936546.685954:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784936546.686017:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784936546.686126:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784936546.686178:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784936546.686217:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784936546.687160:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784936546.687226:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784936546.688145:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784936546.688721:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784936546.688773:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784936546.688819:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784936546.688869:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784936546.688915:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784936546.688960:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784936546.693807:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784936546.693941:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784936546.693982:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784936546.694668:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784936546.694750:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784936546.694788:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784936546.694842:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784936546.694883:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784936546.694933:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784936546.694998:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784936546.696234:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784936546.696611:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784936546.696680:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784936546.696712:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1784936546.696763:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524052096:0@lo:502: 00000100:00100000:2.0:1784936546.696843:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.696880:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849540 going to sleep for 11 seconds 00000100:00100000:1.0:1784936546.697376:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052096 00000100:00100000:1.0:1784936546.697385:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052096 00000100:00100000:1.0:1784936546.697472:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784936546.697482:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524052096:12345-0@lo:502: 00000100:00100000:1.0:1784936546.697721:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524052096:12345-0@lo:502: Request processed in 239us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.697729:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784936546.697994:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524052096:0@lo:502: 00000040:00080000:2.0:1784936546.698352:0:6592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784936546.698365:0:6592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1784936546.700216:0:6618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784936546.700250:0:6618:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9096ff884d40) 00000020:00000080:1.0:1784936546.700346:0:6618:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1784936546.704765:0:6618:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096f4d33000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784936546.704774:0:6618:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096f4d33000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784936546.704777:0:6618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096f4d33000 3 00010000:00080000:2.0:1784936546.704839:0:6618:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096ff890800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1784936546.713752:0:6618:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1784936546.713871:0:6618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784936546.713929:0:6618:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784936546.713950:0:6618:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6cf7a864723f571c 00000100:00080000:2.0:1784936546.713960:0:6618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784936546.713967:0:6618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9096ff890800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1784936546.714010:0:6618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096f4a9ca80 x1871641524052224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784936546.714040:0:6618:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784936546.714467:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1871641524052224:0@lo:38: 00000100:00100000:3.0:1784936546.714545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.714724:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052224 00000100:00100000:2.0:1784936546.714733:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052224 00000100:00100000:3.0:1784936546.714745:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524052352:0@lo:400: 00000100:00100000:2.0:1784936546.714769:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784936546.714777:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1871641524052224:12345-0@lo:38: 00010000:00080000:2.0:1784936546.714802:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000100:00100000:3.0:1784936546.714871:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936546.714937:0:5796:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784936546.714946:0:5796:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784936546.714959:0:5798:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784936546.714966:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052352 00000100:00100000:3.0:1784936546.714969:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052352 00000100:00100000:3.0:1784936546.714998:0:5798:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784936546.715006:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936546.715013:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524052352:12345-0@lo:400: 00000040:00080000:1.0:1784936546.715056:0:6618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1784936546.715068:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524052352:12345-0@lo:400: Request processed in 54us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936546.715076:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784936546.715119:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4ac2300 x1871641524052352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936546.715130:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524052352:0@lo:400: 00000020:00000080:2.0:1784936546.716089:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6cf7a864723f5723 00000004:00100000:2.0:1784936546.716108:0:5797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784936546.716142:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9096ff895800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784936546.716205:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1871641524052224:12345-0@lo:38: Request processed in 1426us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936546.716213:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1784936546.716251:0:6592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1784936546.716535:0:6592:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784936546.716551:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936546.716562:0:6592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784936546.716609:0:6592:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784936546.716611:0:6592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936546.716612:0:6592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936546.716619:0:6592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936546.716620:0:6592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936546.716621:0:6592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936546.716623:0:6592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936546.716624:0:6592:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936546.716625:0:6592:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936546.716627:0:6592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936546.716628:0:6592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784936546.716631:0:6592:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1784936546.716633:0:6592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784936546.716634:0:6592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936546.716635:0:6592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936546.716635:0:6592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936546.716636:0:6592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936546.716637:0:6592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936546.716638:0:6592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936546.716639:0:6592:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784936546.716640:0:6592:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784936546.716641:0:6592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936546.716642:0:6592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784936546.716658:0:6592:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784936546.716669:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524052480:0@lo:253: 00000100:00100000:2.0:1784936546.716704:0:6592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936546.716739:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff8493c0 going to sleep for 11 seconds 00010000:00080000:3.0:1784936546.716878:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9ca80 x1871641524052224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784936556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936546.716898:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784936546.716906:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784936546.717030:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784936546.717037:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784936546.717040:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096ff890800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784936546.717047:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1871641524052224:0@lo:38: 00000100:00100000:0.0:1784936546.723474:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052480 00000100:00100000:0.0:1784936546.723490:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052480 00000100:00100000:0.0:1784936546.723549:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784936546.723559:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:6592:x1871641524052480:12345-0@lo:253: 20000000:01000000:0.0:1784936546.723593:0:5788:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784936546.723609:0:5788:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784936546.786759:0:5788:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784936546.786772:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784936546.786828:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784936546.786832:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784936546.786854:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.786870:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.786878:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.786932:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.786946:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936546.786979:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871641524052608:0@lo:104: 00000100:00100000:1.0:1784936546.787123:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936546.787178:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0480 going to sleep for 11 seconds 00000100:00100000:0.0:1784936546.788402:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052608 00000100:00100000:0.0:1784936546.788413:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052608 00000100:00100000:0.0:1784936546.788467:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936546.788476:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:5812:x1871641524052608:12345-0@lo:104: 00010000:00010000:0.0:1784936546.788491:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936546.788555:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936546.788562:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:5812:x1871641524052608:12345-0@lo:104: Request processed in 86us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936546.788584:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1784936546.788923:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936546.788930:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.788938:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fcc00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936546.788942:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.788952:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936546.788958:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936546.788964:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784936546.789016:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.789022:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784936546.789733:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524052736:0@lo:103: 00000100:00100000:0.0:1784936546.789785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784936546.790149:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790159:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f5682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5689 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790179:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936546.790191:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936546.790193:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936546.790212:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052736 00000100:00100000:1.0:1784936546.790219:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052736 00010000:00010000:1.0:1784936546.790241:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 14 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936546.790280:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784936546.790289:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c82b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+14:3306:x1871641524052736:12345-0@lo:103: 00010000:00010000:1.0:1784936546.790302:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936546.790307:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 14 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790317:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 14 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790336:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790344:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784936546.790359:0:5783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003527537s 00010000:00010000:1.0:1784936546.790364:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790371:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790378:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790394:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790400:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fc600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936546.790403:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790413:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790422:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790445:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936546.790700:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c82b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+14:3306:x1871641524052736:12345-0@lo:103: Request processed in 411us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936546.790708:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1784936546.790769:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fd200/0x6cf7a864723f5689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5682 expref: 13 pid: 5788 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936546.790779:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871641524052608:0@lo:104: 00010000:00010000:1.0:1784936546.790794:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790802:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790809:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936546.790824:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fc600/0x6cf7a864723f572a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936546.801610:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524052736:0@lo:103: 00000100:00100000:2.0:1784936546.808825:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:6592:x1871641524052480:12345-0@lo:253: Request processed in 85258us (92109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936546.808840:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784936546.814690:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:6592:1871641524052480:0@lo:253: 10000000:01000000:0.0:1784936546.814712:0:6592:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784936546.814716:0:6592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784936546.814718:0:6592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784936546.814719:0:6592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936546.814720:0:6592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936546.814722:0:6592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936546.814723:0:6592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936546.814724:0:6592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936546.814726:0:6592:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784936546.814728:0:6592:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784936546.814729:0:6592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936546.814730:0:6592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784936546.814752:0:6592:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784936546.827843:0:6592:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936546.828251:0:6592:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784936546.828717:0:6592:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936546.828881:0:6592:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784936546.832768:0:6592:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936546.835374:0:6592:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784936546.844966:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784936547.064736:0:6592:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1784936547.064743:0:6592:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1784936547.064778:0:6592:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784936547.064832:0:6592:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784936547.064848:0:6592:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784936547.064874:0:6592:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784936547.659644:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936548.681518:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936549.706102:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936550.728769:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936551.752807:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936551.816939:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524052864:0@lo:400: 00000100:00100000:3.0:1784936551.817045:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524052992:0@lo:400: 00000100:00100000:3.0:1784936551.817126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936551.817467:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784936551.817490:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524053120:0@lo:400: 00000100:00100000:0.0:1784936551.817525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936551.817690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936551.817727:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052864 00000100:00100000:1.0:1784936551.817734:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052864 00000100:00100000:1.0:1784936551.817770:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784936551.817778:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:3307:x1871641524052864:12345-0@lo:400: 00000100:00100000:1.0:1784936551.817835:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:3307:x1871641524052864:12345-0@lo:400: Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936551.817841:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784936551.817893:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524052864:0@lo:400: 00000100:00100000:2.0:1784936551.820098:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524052992 00000100:00100000:2.0:1784936551.820110:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524052992 00000100:00100000:2.0:1784936551.820157:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053120 00000100:00100000:2.0:1784936551.820161:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053120 00000100:00100000:2.0:1784936551.820229:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936551.820238:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524052992:12345-0@lo:400: 00000100:00100000:2.0:1784936551.820321:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524052992:12345-0@lo:400: Request processed in 84us (3194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936551.820328:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936551.820344:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784936551.820351:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524053120:12345-0@lo:400: 00000100:00100000:2.0:1784936551.820383:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524053120:12345-0@lo:400: Request processed in 33us (2856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936551.820389:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784936551.820472:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784936551.822123:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096fb2f9880 x1871641524052992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936551.822141:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524052992:0@lo:400: 00010000:00080000:3.0:1784936551.822208:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096fb2f8e00 x1871641524053120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936551.822218:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524053120:0@lo:400: 00010000:00010000:3.0:1784936552.782752:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936553.800602:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784936554.346363:0:6963:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784936554.824904:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936555.851876:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784936555.912691:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784936555.912700:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096d473e000 from 21 10000000:01000000:3.0:1784936555.912704:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784936555.912762:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.912774:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.912787:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936555.912813:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053248:0@lo:101: 00000100:00100000:3.0:1784936555.912880:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936555.912918:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a24b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936555.912994:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053248 00000100:00100000:2.0:1784936555.913002:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053248 00000100:00100000:2.0:1784936555.913057:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784936555.913067:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524053248:12345-0@lo:101: 00010000:00010000:2.0:1784936555.913081:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936555.913094:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5731 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936555.913117:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936555.913128:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936555.913136:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b200, rc 0) 00000100:00100000:2.0:1784936555.913188:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524053248:12345-0@lo:101: Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936555.913194:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784936555.913669:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053248:0@lo:101: 00010000:00010000:0.0:1784936555.913694:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936555.913705:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936555.913775:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053376:0@lo:501: 00000100:00100000:0.0:1784936555.913805:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936555.913830:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936555.915116:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053376 00000100:00100000:0.0:1784936555.915128:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053376 00000100:00100000:0.0:1784936555.915183:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784936555.915192:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524053376:12345-0@lo:501: 00000100:00100000:0.0:1784936555.915634:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524053376:12345-0@lo:501: Request processed in 442us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936555.915642:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784936555.915769:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053376:0@lo:501: 00000100:00100000:0.0:1784936555.915816:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053504:0@lo:503: 00000100:00100000:0.0:1784936555.915865:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936555.915901:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936555.915946:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053504 00000100:00100000:3.0:1784936555.915952:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053504 00000100:00100000:3.0:1784936555.915983:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784936555.915990:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524053504:12345-0@lo:503: 00000100:00100000:3.0:1784936555.916275:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524053504:12345-0@lo:503: Request processed in 285us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936555.916282:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784936555.916460:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053504:0@lo:503: 00000100:00100000:0.0:1784936555.917333:0:7038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7038:1871641524053632:0@lo:502: 00000100:00100000:0.0:1784936555.917385:0:7038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936555.917469:0:7038:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702840 going to sleep for 11 seconds 00000100:00100000:3.0:1784936555.917544:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053632 00000100:00100000:3.0:1784936555.917550:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053632 00000100:00100000:3.0:1784936555.917658:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784936555.917668:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7038:x1871641524053632:12345-0@lo:502: 00000100:00100000:3.0:1784936555.917962:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7038:x1871641524053632:12345-0@lo:502: Request processed in 295us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936555.917971:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784936555.918047:0:7038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7038:1871641524053632:0@lo:502: 00000100:00100000:1.0:1784936555.918108:0:7038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7038:1871641524053760:0@lo:502: 00000100:00100000:1.0:1784936555.918142:0:7038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936555.918288:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053760 00000100:00100000:0.0:1784936555.918293:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053760 00000100:00100000:0.0:1784936555.918323:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784936555.918331:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:7038:x1871641524053760:12345-0@lo:502: 00000100:00100000:0.0:1784936555.918507:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:7038:x1871641524053760:12345-0@lo:502: Request processed in 177us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936555.918514:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784936555.918729:0:7038:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936555.918746:0:7038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7038:1871641524053760:0@lo:502: 00000040:00080000:1.0:1784936555.918770:0:7038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1784936555.918957:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1784936555.918977:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784936555.918987:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.918997:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936555.919006:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784936555.919009:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096d473e000 from 4 10000000:01000000:3.0:1784936555.919013:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784936555.919040:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.919047:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.919057:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936555.919082:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053888:0@lo:101: 00000100:00100000:3.0:1784936555.919192:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936555.919247:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936555.919288:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524053888 00000100:00100000:0.0:1784936555.919293:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524053888 00000100:00100000:0.0:1784936555.919364:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784936555.919373:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524053888:12345-0@lo:101: 00010000:00010000:0.0:1784936555.919383:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936555.919397:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f573f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936555.919419:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f573f expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936555.919478:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f573f expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936555.919488:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0031200, rc 0) 00000100:00100000:0.0:1784936555.919527:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524053888:12345-0@lo:101: Request processed in 156us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936555.919534:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784936555.919602:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524053888:0@lo:101: 00010000:00010000:1.0:1784936555.919615:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936555.919624:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936555.919670:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054016:0@lo:256: 00000100:00100000:1.0:1784936555.919701:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936555.919823:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936555.919857:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054016 00000100:00100000:3.0:1784936555.919861:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054016 00000100:00100000:3.0:1784936555.919884:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784936555.919891:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524054016:12345-0@lo:256: 20000000:01000000:3.0:1784936555.919905:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784936555.919921:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784936555.919924:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784936555.919997:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524054016:12345-0@lo:256: Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936555.920005:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784936555.920171:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054016:0@lo:256: 10000000:01000000:1.0:1784936555.920211:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784936555.920218:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936555.920227:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936555.920236:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784936555.920238:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784936555.920241:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784936555.920258:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936555.920265:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936555.920273:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936555.920294:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054144:0@lo:101: 00000100:00100000:1.0:1784936555.920317:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936555.920376:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936555.920405:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054144 00000100:00100000:3.0:1784936555.920409:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054144 00000100:00100000:3.0:1784936555.920526:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784936555.920534:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524054144:12345-0@lo:101: 00010000:00010000:3.0:1784936555.920542:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936555.920552:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f574d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.920568:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f574d expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.920578:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f574d expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936555.920584:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5e00, rc 0) 00000100:00100000:3.0:1784936555.920630:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524054144:12345-0@lo:101: Request processed in 96us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936555.920636:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784936555.920688:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054144:0@lo:101: 00010000:00010000:1.0:1784936555.920699:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936555.920708:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936555.920767:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054272:0@lo:501: 00000100:00100000:1.0:1784936555.920791:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936555.921468:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936555.921584:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054272 00000100:00100000:0.0:1784936555.921591:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054272 00000100:00100000:0.0:1784936555.921622:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784936555.921629:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524054272:12345-0@lo:501: 00000100:00100000:0.0:1784936555.921898:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524054272:12345-0@lo:501: Request processed in 268us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936555.921913:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784936555.922053:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054272:0@lo:501: 00000100:00100000:1.0:1784936555.922155:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054400:0@lo:503: 00000100:00100000:1.0:1784936555.922197:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936555.922259:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936555.922289:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054400 00000100:00100000:0.0:1784936555.922294:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054400 00000100:00100000:0.0:1784936555.922357:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784936555.922364:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524054400:12345-0@lo:503: 00000100:00100000:0.0:1784936555.926681:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524054400:12345-0@lo:503: Request processed in 4308us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936555.926696:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784936555.927059:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054400:0@lo:503: 00000100:00100000:1.0:1784936555.927573:0:7040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7040:1871641524054528:0@lo:502: 00000100:00100000:1.0:1784936555.927631:0:7040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936555.927665:0:7040:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936555.927709:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054528 00000100:00100000:3.0:1784936555.927725:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054528 00000100:00100000:3.0:1784936555.927773:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784936555.927782:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7040:x1871641524054528:12345-0@lo:502: 00000100:00100000:3.0:1784936555.928065:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7040:x1871641524054528:12345-0@lo:502: Request processed in 284us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936555.928073:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784936555.928231:0:7040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7040:1871641524054528:0@lo:502: 00000020:01000000:1.0:1784936555.928256:0:7040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784936555.928265:0:7040:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784936555.928276:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936555.928278:0:7040:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784936555.928283:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784936555.928287:0:7040:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:1.0:1784936555.928311:0:7040:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784936555.928314:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784936555.928328:0:7040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9096ff8819c0) 00000020:00000080:1.0:1784936555.928348:0:7040:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784936555.928353:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784936555.928421:0:7040:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784936555.928496:0:7040:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784936555.928504:0:7040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f5762 00010000:00080000:1.0:1784936555.928535:0:7040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096f4d00000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:1.0:1784936555.928792:0:7040:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784936556.007516:0:7040:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784936556.007536:0:7040:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784936556.008092:0:7040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936556.008261:0:7040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936556.008311:0:7040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784936556.008373:0:7040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1784936556.009746:0:7044:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784936556.009752:0:7044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784936556.011850:0:7040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784936556.011865:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784936556.011901:0:7040:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784936556.011923:0:7040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f5769 00000100:00080000:0.0:1784936556.011934:0:7040:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784936556.011939:0:7040:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9096f4d00000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936556.011974:0:7040:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096c7caea00 x1871641524054656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784936556.012002:0:7040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784936556.012068:0:7040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936556.012073:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936556.012075:0:7040:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784936556.012085:0:7040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936556.012089:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936556.012090:0:7040:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784936556.012093:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784936556.012095:0:7040:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784936556.012122:0:7040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7040:1871641524054784:0@lo:502: 00000100:00100000:0.0:1784936556.012198:0:7040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936556.012248:0:7040:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936556.012271:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054784 00000100:00100000:0.0:1784936556.012276:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054784 00000100:00100000:0.0:1784936556.012320:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784936556.012330:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7040:x1871641524054784:12345-0@lo:502: 00000100:00100000:0.0:1784936556.012584:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7040:x1871641524054784:12345-0@lo:502: Request processed in 254us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936556.012592:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784936556.012646:0:7040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7040:1871641524054784:0@lo:502: 00000020:01000000:0.0:1784936556.012670:0:7040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936556.012674:0:7040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936556.012676:0:7040:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784936556.012680:0:7040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1784936556.012742:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1784936556.012760:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784936556.012770:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.012779:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936556.012787:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784936556.012796:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9096c8a88000 from 1 10000000:01000000:0.0:1784936556.012798:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784936556.012822:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.012830:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.012838:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936556.012849:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054912:0@lo:101: 00000100:00100000:0.0:1784936556.012875:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936556.012889:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936556.012903:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054912 00000100:00100000:0.0:1784936556.012907:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054912 00000100:00100000:0.0:1784936556.012929:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784936556.012935:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524054912:12345-0@lo:101: 00010000:00010000:0.0:1784936556.012944:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936556.012956:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5770 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.012977:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.012987:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.012995:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0031800, rc 0) 00000100:00100000:0.0:1784936556.013023:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524054912:12345-0@lo:101: Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936556.013035:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784936556.013064:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524054912:0@lo:101: 00010000:00010000:0.0:1784936556.013076:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.013084:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936556.013124:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524055040:0@lo:501: 00000100:00100000:0.0:1784936556.013149:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936556.013162:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936556.013172:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055040 00000100:00100000:0.0:1784936556.013175:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055040 00000100:00100000:0.0:1784936556.013192:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784936556.013198:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524055040:12345-0@lo:501: 00000100:00100000:0.0:1784936556.013378:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524055040:12345-0@lo:501: Request processed in 179us (227us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784936556.013385:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784936556.013411:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524055040:0@lo:501: 10000000:01000000:0.0:1784936556.013447:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784936556.013452:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936556.013459:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936556.013842:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524055168:0@lo:400: 00000100:00100000:0.0:1784936556.013886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936556.014053:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524054656:0@lo:8: 00000100:00100000:3.0:1784936556.014093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936556.014153:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784936556.014161:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524055296:0@lo:400: 00000100:00100000:3.0:1784936556.014186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936556.015026:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524054656 00000100:00100000:0.0:1784936556.015035:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524054656 00000100:00100000:0.0:1784936556.015068:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936556.015074:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1871641524054656:12345-0@lo:8: 00010000:00080000:0.0:1784936556.015098:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1784936556.015134:0:6595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f577e 00002000:00100000:0.0:1784936556.015175:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9096ff5a9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784936556.015179:0:6595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1784936556.015183:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784936556.015304:0:6595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784936556.016564:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784936556.016610:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9096ff5ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936556.016728:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1871641524054656:12345-0@lo:8: Request processed in 1651us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936556.016737:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784936556.016803:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096c7caea00 x1871641524054656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784936566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936556.016813:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784936556.016821:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784936556.016828:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784936556.016833:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784936556.016835:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096f4d00000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784936556.016847:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784936556.016851:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524054656:0@lo:8: 00000004:00080000:0.0:1784936556.016877:0:7044:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784936556.017005:0:7044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221768576311ns, next at 0ns, rc = 0 00000100:00100000:2.0:1784936556.017809:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055168 00000100:00100000:2.0:1784936556.017818:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055168 00000100:00100000:3.0:1784936556.017862:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055296 00000100:00100000:2.0:1784936556.017867:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784936556.017869:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055296 00000100:00100000:2.0:1784936556.017878:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524055168:12345-0@lo:400: 00000100:00100000:3.0:1784936556.017915:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784936556.017925:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524055296:12345-0@lo:400: 00000100:00100000:2.0:1784936556.017947:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524055168:12345-0@lo:400: Request processed in 71us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936556.017954:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784936556.017974:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524055296:12345-0@lo:400: Request processed in 51us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936556.017982:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784936556.018022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9d180 x1871641524055296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936556.018035:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524055296:0@lo:400: 00000100:00080000:0.0:1784936556.019759:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784936556.020117:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9ed80 x1871641524055168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936556.020133:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524055168:0@lo:400: 00000004:00080000:1.0:1784936556.080346:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1784936556.105489:0:7045:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784936556.105527:0:7045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524055552:0@lo:7: 00000100:00100000:2.0:1784936556.105606:0:7045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936556.105663:0:7045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936556.105679:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524055424:0@lo:13: 00000100:00100000:2.0:1784936556.105705:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936556.105749:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055552 00000100:00100000:3.0:1784936556.105757:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055552 00000100:00100000:2.0:1784936556.105757:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055424 00000100:00100000:2.0:1784936556.105759:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055424 00000100:00100000:3.0:1784936556.105803:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784936556.105803:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784936556.105811:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7045:x1871641524055552:12345-0@lo:7: 00000100:00100000:2.0:1784936556.105811:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871641524055424:12345-0@lo:13: 00002000:00000024:2.0:1784936556.105842:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1784936556.105884:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1871641524055424:12345-0@lo:13: Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936556.105890:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1784936556.105909:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784936556.105939:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9d880 x1871641524055424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936556.105957:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524055424:0@lo:13: 00002000:00080000:3.0:1784936556.111056:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1784936556.111064:0:6598:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784936556.111157:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7045:x1871641524055552:12345-0@lo:7: Request processed in 5343us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936556.111167:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784936556.111203:0:7045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9ce00 x1871641524055552/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784936572 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936556.111231:0:7045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524055552:0@lo:7: 00000004:00080000:2.0:1784936556.111245:0:7045:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784936556.111283:0:7045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524055680:0@lo:5: 00000100:00100000:2.0:1784936556.111316:0:7045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936556.111395:0:7045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936556.111487:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055680 00000100:00100000:0.0:1784936556.111494:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055680 00000100:00100000:0.0:1784936556.111611:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936556.111621:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7045:x1871641524055680:12345-0@lo:5: 00002000:00080000:0.0:1784936556.111647:0:6597:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784936556.111651:0:6597:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784936556.111892:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7045:x1871641524055680:12345-0@lo:5: Request processed in 272us (574us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784936556.111899:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784936556.111950:0:7045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9ce00 x1871641524055680/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784936572 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936556.111963:0:7045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524055680:0@lo:5: 00000004:00080000:2.0:1784936556.111972:0:7045:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784936556.111995:0:7045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524055808:0@lo:700: 00000100:00100000:2.0:1784936556.112021:0:7045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936556.112037:0:7045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936556.112054:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055808 00000100:00100000:2.0:1784936556.112058:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055808 00000100:00100000:2.0:1784936556.112096:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936556.112103:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7045:x1871641524055808:12345-0@lo:700: 00000100:00100000:2.0:1784936556.112129:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6604:1871641524055936:0@lo:700: 00000100:00100000:2.0:1784936556.112159:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936556.112180:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936556.112201:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524055936 00000100:00100000:2.0:1784936556.112205:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524055936 00000100:00100000:2.0:1784936556.112228:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936556.112234:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6604:x1871641524055936:12345-0@lo:700: 40000000:02000000:0.0:1784936556.134628:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1784936556.141792:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6604:x1871641524055936:12345-0@lo:700: Request processed in 29547us (29620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936556.141813:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784936556.141945:0:6604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9ed80 x1871641524055936/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784936572 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936556.141976:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6604:1871641524055936:0@lo:700: 40000000:02000000:2.0:1784936556.141992:0:6604:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1784936556.224902:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1784936556.224917:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784936556.225175:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7045:x1871641524055808:12345-0@lo:700: Request processed in 113067us (113148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936556.225192:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784936556.225445:0:7045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9dc00 x1871641524055808/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784936572 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936556.225457:0:7045:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784936556.225474:0:7045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524055808:0@lo:700: 00000004:02000040:3.0:1784936556.299159:0:7045:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1784936556.313934:0:7045:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524056064:0@lo:5: 00000100:00100000:2.0:1784936556.314003:0:7045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936556.314054:0:7045:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936556.314470:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056064 00000100:00100000:3.0:1784936556.314479:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056064 00000100:00100000:3.0:1784936556.314540:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936556.314551:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7045:x1871641524056064:12345-0@lo:5: 00002000:00080000:2.0:1784936556.339416:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1784936556.339460:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1784936556.342233:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7045:x1871641524056064:12345-0@lo:5: Request processed in 27677us (28222us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784936556.342251:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784936556.342306:0:7045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9ed80 x1871641524056064/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784936572 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936556.342322:0:7045:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7045:1871641524056064:0@lo:5: 00000004:00080000:2.0:1784936556.342337:0:7045:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1784936556.877542:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936557.898544:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936558.924574:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784936559.878917:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1784936559.949309:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936560.972121:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936561.033281:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524056192:0@lo:400: 00000100:00100000:2.0:1784936561.033346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936561.033390:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784936561.033397:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524056320:0@lo:400: 00000100:00100000:2.0:1784936561.033421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936561.033782:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524056448:0@lo:400: 00000100:00100000:2.0:1784936561.034215:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524056576:0@lo:400: 00000100:00100000:2.0:1784936561.034244:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936561.034381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936561.034477:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056320 00000100:00100000:3.0:1784936561.034488:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056320 00000100:00100000:3.0:1784936561.034539:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056448 00000100:00100000:3.0:1784936561.034542:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056448 00000100:00100000:3.0:1784936561.034576:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784936561.034586:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524056320:12345-0@lo:400: 00000100:00100000:2.0:1784936561.034622:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056192 00000100:00100000:2.0:1784936561.034629:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056192 00000100:00100000:2.0:1784936561.034666:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784936561.034673:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524056320:12345-0@lo:400: Request processed in 87us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936561.034686:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936561.034687:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:3305:x1871641524056192:12345-0@lo:400: 00000100:00100000:2.0:1784936561.034725:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:3305:x1871641524056192:12345-0@lo:400: Request processed in 44us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936561.034731:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784936561.034783:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056576 00000100:00100000:0.0:1784936561.034787:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056576 00000100:00100000:0.0:1784936561.035100:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936561.035108:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524056576:12345-0@lo:400: 00000100:00100000:0.0:1784936561.035158:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524056576:12345-0@lo:400: Request processed in 52us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936561.035165:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784936561.035226:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1784936561.035247:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936561.035253:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936561.035255:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524056448:12345-0@lo:400: 00010000:00080000:2.0:1784936561.035297:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9e300 x1871641524056576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936561.035308:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784936561.035334:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524056576:0@lo:400: 00000100:00100000:3.0:1784936561.038975:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524056448:12345-0@lo:400: Request processed in 3731us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936561.038989:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1784936561.039945:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9f800 x1871641524056320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936561.039963:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524056320:0@lo:400: 00010000:00080000:1.0:1784936561.039993:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4a9fb80 x1871641524056448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936561.040151:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524056192:0@lo:400: 00000100:00100000:1.0:1784936561.040208:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524056448:0@lo:400: 00000100:00100000:1.0:1784936561.544893:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784936561.544925:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524056704:0@lo:13: 00000100:00100000:1.0:1784936561.545018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936561.545110:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056704 00000100:00100000:3.0:1784936561.545119:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056704 00000100:00100000:3.0:1784936561.545179:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936561.545189:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524056704:12345-0@lo:13: 00002000:00000024:3.0:1784936561.545225:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936561.545279:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524056704:12345-0@lo:13: Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936561.545286:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784936561.545363:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096c7caf100 x1871641524056704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936561.545384:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524056704:0@lo:13: 00010000:00010000:0.0:1784936561.993277:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936563.023449:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936564.042335:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936565.064560:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784936565.689585:0:7491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784936565.689590:0:7491:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784936565.689732:0:7491:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9096ffa3c000 00000020:01000004:3.0:1784936565.689750:0:7491:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784936565.689763:0:7491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784936565.689776:0:7491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9096d0c03380) 00000020:00000080:3.0:1784936565.689796:0:7491:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784936565.702869:0:7491:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784936565.703220:0:7491:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1784936565.723758:0:7491:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1784936565.730855:0:7491:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1784936565.730890:0:7491:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1784936565.730949:0:7491:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1784936565.730989:0:7491:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1784936565.731371:0:7491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1784936565.731383:0:7491:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784936565.731396:0:7491:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6cf7a864723f578c 00000020:01000004:0.0:1784936565.731404:0:7491:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1784936565.731451:0:7491:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784936565.731455:0:7491:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784936565.731462:0:7491:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1784936565.731484:0:7491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1784936565.731488:0:7491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784936565.748003:0:7491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784936565.748041:0:7491:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.101@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1784936565.748046:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784936565.748047:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784936565.748049:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784936565.748050:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784936565.748051:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784936565.748052:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784936565.748058:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784936565.748059:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784936565.748061:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784936565.748062:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784936565.748063:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784936565.748067:0:7491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1784936565.748069:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784936565.748070:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784936565.748071:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784936565.748072:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784936565.748073:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784936565.748074:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784936565.748075:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784936565.748076:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784936565.748076:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784936565.748077:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784936565.748078:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784936565.748104:0:7491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784936565.748124:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524056832:0@lo:253: 00000100:00100000:1.0:1784936565.748192:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.748393:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849240 going to sleep for 11 seconds 00000100:00100000:2.0:1784936565.751395:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056832 00000100:00100000:2.0:1784936565.751410:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056832 00000100:00100000:2.0:1784936565.751488:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784936565.751497:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+16:7491:x1871641524056832:12345-0@lo:253: 20000000:01000000:2.0:1784936565.751542:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784936565.751547:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1784936565.751559:0:5790:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1784936565.751562:0:5790:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1784936565.752493:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784936565.752713:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1784936565.752725:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1784936565.752758:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1784936565.752771:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1784936565.752798:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1784936565.752837:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1784936565.753173:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1784936565.753190:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:2.0:1784936565.753192:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:2.0:1784936565.753219:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1784936565.753226:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784936565.753261:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1784936565.753268:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:2.0:1784936565.753292:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1784936565.753299:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784936565.753321:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1784936565.753359:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1784936565.754058:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1784936565.754074:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.101@tcp 20000000:01000000:2.0:1784936565.754076:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.101@tcp (null) (null) (null) 00000040:00080000:2.0:1784936565.754106:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1784936565.754113:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784936565.754137:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1784936565.754142:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.101@tcp (null) (null) 00000040:00080000:2.0:1784936565.754165:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1784936565.754171:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784936565.754207:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1784936565.754249:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1784936565.754263:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784936565.754265:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784936565.754269:0:5790:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784936565.754280:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784936565.754283:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784936565.754312:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784936565.754314:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784936565.761688:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784936565.761795:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784936565.761825:0:7494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1784936565.767627:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1784936565.767683:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1784936565.767758:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1784936565.767774:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784936565.767777:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784936565.768512:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1784936565.768592:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1784936565.768644:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784936565.771151:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1784936565.771209:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1784936565.771252:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1784936565.771267:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784936565.771270:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784936565.779863:0:7496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1784936565.779954:0:7496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1784936565.780011:0:7496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1784936565.782176:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1784936565.782229:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1784936565.782301:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1784936565.782315:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1784936565.782318:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784936565.782972:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1784936565.783218:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1784936565.783262:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1784936565.783325:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1784936565.783342:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1784936565.783344:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1784936565.783352:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784936565.783371:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783389:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783397:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783404:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783411:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f574d expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783418:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783456:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783496:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783535:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.783667:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524056960:0@lo:104: 00000100:00100000:2.0:1784936565.783735:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784936565.783838:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f574d expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783848:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f574d expref: 16 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.783856:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057088:0@lo:104: 00010000:00010000:2.0:1784936565.783885:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783893:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 16 pid: 5788 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.783901:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057216:0@lo:104: 00010000:00010000:2.0:1784936565.783927:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783935:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 16 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.783943:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057344:0@lo:104: 00010000:00010000:2.0:1784936565.783967:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.783985:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 16 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.783994:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057472:0@lo:104: 00000100:00100000:2.0:1784936565.784013:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096f4ab9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.788086:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784936565.788145:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.788184:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.788197:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.788207:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.788219:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524056960 00000100:00100000:0.0:1784936565.788241:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524056960 00000100:00100000:0.0:1784936565.788277:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057088 00000100:00100000:0.0:1784936565.788279:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057088 00000100:00100000:0.0:1784936565.788288:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057216 00000100:00100000:0.0:1784936565.788290:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057216 00000100:00100000:0.0:1784936565.788299:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057344 00000100:00100000:0.0:1784936565.788301:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057344 00000100:00100000:0.0:1784936565.788308:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057472 00000100:00100000:0.0:1784936565.788310:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057472 00000100:00100000:0.0:1784936565.788321:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936565.788328:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0093450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+7:5790:x1871641524056960:12345-0@lo:104: 00010000:00010000:0.0:1784936565.788348:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788495:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936565.788502:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0093450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+7:5790:x1871641524056960:12345-0@lo:104: Request processed in 174us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.788509:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936565.788574:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784936565.788581:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+6:5790:x1871641524057088:12345-0@lo:104: 00010000:00010000:0.0:1784936565.788589:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788624:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784936565.788629:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+6:5790:x1871641524057088:12345-0@lo:104: Request processed in 50us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.788636:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784936565.788647:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784936565.788653:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+5:5790:x1871641524057216:12345-0@lo:104: 00010000:00010000:0.0:1784936565.788668:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788700:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784936565.788705:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+5:5790:x1871641524057216:12345-0@lo:104: Request processed in 53us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.788712:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784936565.788726:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784936565.788731:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:5790:x1871641524057344:12345-0@lo:104: 00010000:00010000:0.0:1784936565.788737:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788762:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1784936565.788767:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:5790:x1871641524057344:12345-0@lo:104: Request processed in 36us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.788772:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784936565.788782:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784936565.788787:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:5790:x1871641524057472:12345-0@lo:104: 00010000:00010000:0.0:1784936565.788794:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788817:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1784936565.788821:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:5790:x1871641524057472:12345-0@lo:104: Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.788827:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784936565.788843:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784936565.788849:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788862:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0030e00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.788867:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788876:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.788883:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.788889:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.788924:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788931:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.788952:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788960:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f5770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5777 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788974:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784936565.788977:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.788983:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fce00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.788986:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789003:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.789009:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.789014:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.789028:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789034:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.789047:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789054:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f574d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5754 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789062:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784936565.789065:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789070:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.789072:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789078:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.789084:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.789095:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.789110:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789115:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.789120:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789125:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f5731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5738 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789134:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784936565.789136:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789141:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165ac00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.789144:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789149:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.789155:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.789160:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.789171:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789177:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.789188:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789194:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c165ac00/0x6cf7a864723f5707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f570e expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789204:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936565.789207:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789213:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.789216:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789222:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.789228:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.789232:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.789244:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789249:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.789253:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789259:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f56dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f56e4 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.789283:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936565.789290:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936565.789292:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936565.789575:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524057728:0@lo:103: 00000100:00100000:1.0:1784936565.789622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.789679:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784936565.789686:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524057856:0@lo:103: 00000100:00100000:1.0:1784936565.789707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.789736:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057728 00000100:00100000:1.0:1784936565.789741:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057728 00010000:00010000:1.0:1784936565.789765:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f574d expref: 17 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.789789:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057856 00000100:00100000:1.0:1784936565.789793:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057856 00010000:00010000:1.0:1784936565.789804:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 18 pid: 5788 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.789818:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784936565.789824:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+18:3307:x1871641524057728:12345-0@lo:103: 00010000:00010000:1.0:1784936565.789839:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936565.789844:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f574d expref: 18 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.789854:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f574d expref: 18 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.789874:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936565.789903:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+18:3307:x1871641524057728:12345-0@lo:103: Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936565.789910:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784936565.789925:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784936565.789931:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+17:3307:x1871641524057856:12345-0@lo:103: 00010000:00010000:1.0:1784936565.789939:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936565.789943:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 17 pid: 5788 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.789957:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 17 pid: 5788 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.789967:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936565.789991:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+17:3307:x1871641524057856:12345-0@lo:103: Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936565.789997:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784936565.790030:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524057856:0@lo:103: 00000100:00100000:1.0:1784936565.790040:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524057728:0@lo:103: 00010000:00010000:0.0:1784936565.791768:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936565.791930:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524056960:0@lo:104: 00000100:00100000:3.0:1784936565.791950:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524057600:0@lo:103: 00000100:00100000:3.0:1784936565.792015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936565.792104:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524057984:0@lo:103: 00010000:00010000:2.0:1784936565.792145:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f5754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f574d expref: 16 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.792163:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057088:0@lo:104: 00010000:00010000:2.0:1784936565.792174:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165b200/0x6cf7a864723f5738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5731 expref: 15 pid: 5788 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936565.792183:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057216:0@lo:104: 00000100:00100000:2.0:1784936565.792192:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057344:0@lo:104: 00000100:00100000:2.0:1784936565.792199:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1871641524057472:0@lo:104: 00010000:00010000:2.0:1784936565.792230:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936565.792300:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524058112:0@lo:103: 00000100:00100000:3.0:1784936565.792321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936565.797149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.801871:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057600 00000100:00100000:1.0:1784936565.801886:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057600 00010000:00010000:1.0:1784936565.801942:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 15 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.801982:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058112 00000100:00100000:1.0:1784936565.801985:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058112 00010000:00010000:1.0:1784936565.801997:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 16 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.802012:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784936565.802021:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+16:3306:x1871641524057600:12345-0@lo:103: 00010000:00010000:1.0:1784936565.802038:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936565.802043:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.802057:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.802094:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5770 expref: 16 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.802112:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936565.802193:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+15:3306:x1871641524057600:12345-0@lo:103: Request processed in 173us (10178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936565.802200:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784936565.802217:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784936565.802223:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+14:3306:x1871641524058112:12345-0@lo:103: 00010000:00010000:1.0:1784936565.802230:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936565.802234:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 14 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.802242:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 14 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.802252:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f56e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f56dd expref: 14 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.802260:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936565.802279:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+13:3306:x1871641524058112:12345-0@lo:103: Request processed in 57us (9957us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936565.802284:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784936565.802471:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524057600:0@lo:103: 00000100:00100000:3.0:1784936565.802482:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524058112:0@lo:103: 00000100:00100000:1.0:1784936565.810809:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524057984 00000100:00100000:1.0:1784936565.810826:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524057984 00010000:00010000:1.0:1784936565.810869:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 13 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.810912:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784936565.810932:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+13:3305:x1871641524057984:12345-0@lo:103: 00010000:00010000:1.0:1784936565.810947:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936565.810953:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 13 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.810969:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 13 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.810988:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f570e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5707 expref: 13 pid: 5790 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811005:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811013:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811029:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811037:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811044:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811050:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811057:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165a400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936565.811061:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811075:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811098:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.811109:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936565.811166:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+12:3305:x1871641524057984:12345-0@lo:103: Request processed in 235us (14025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936565.811172:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784936565.811276:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524057984:0@lo:103: 00010000:00010000:2.0:1784936565.811303:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.811311:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.811329:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165a400/0x6cf7a864723f5793 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784936565.811347:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784936565.879646:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+11:7491:x1871641524056832:12345-0@lo:253: Request processed in 128138us (131442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.879771:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524056832:0@lo:253: 10000000:01000000:0.0:1784936565.879795:0:7491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784936565.879799:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784936565.879801:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784936565.879803:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936565.879804:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1784936565.879806:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936565.879807:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936565.879809:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936565.879811:0:7491:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784936565.879813:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936565.879814:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784936565.879845:0:7491:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9096ffa3c000 from lustre-OST0001 10000000:01000000:0.0:1784936565.879886:0:7491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1784936565.879890:0:7491:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784936565.879913:0:7491:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9096c8a88000 local copy 10000000:01000000:0.0:1784936565.879919:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784936565.879972:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.879986:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.879997:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936565.880020:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058240:0@lo:101: 00000100:00100000:0.0:1784936565.880071:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.880136:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c830ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.880272:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058240 00000100:00100000:3.0:1784936565.880282:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058240 00000100:00100000:3.0:1784936565.880342:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784936565.880354:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524058240:12345-0@lo:101: 00010000:00010000:3.0:1784936565.880372:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936565.880389:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f57a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f579a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.880419:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f57a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f579a expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.880456:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f57a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f579a expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.880466:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936565.880542:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524058240:12345-0@lo:101: Request processed in 191us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.880549:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784936565.880599:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058240:0@lo:101: 00010000:00010000:3.0:1784936565.880615:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.880624:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936565.880762:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058368:0@lo:501: 00000100:00100000:3.0:1784936565.880792:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.880815:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c385dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.880831:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058368 00000100:00100000:3.0:1784936565.880834:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058368 00000100:00100000:3.0:1784936565.880863:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784936565.880870:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524058368:12345-0@lo:501: 00000100:00100000:3.0:1784936565.881234:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524058368:12345-0@lo:501: Request processed in 363us (440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784936565.881243:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784936565.881280:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058368:0@lo:501: 10000000:01000000:3.0:1784936565.881293:0:7491:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784936565.881321:0:7491:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784936565.881327:0:7491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.881337:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.881351:0:7491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.881368:0:7491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784936565.881392:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9096ffa3c000 10000000:01000000:3.0:1784936565.881397:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784936565.881401:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784936565.881404:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784936565.881409:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784936565.881412:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784936565.881463:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.881471:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.881479:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936565.881492:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058496:0@lo:101: 00000100:00100000:3.0:1784936565.881537:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.881561:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c385db40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.881575:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058496 00000100:00100000:3.0:1784936565.881579:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058496 00000100:00100000:3.0:1784936565.881600:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784936565.881606:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524058496:12345-0@lo:101: 00010000:00010000:3.0:1784936565.881617:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936565.881629:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f57a8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.882036:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1784936565.882218:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.882233:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.882244:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5600, rc 0) 00000100:00100000:3.0:1784936565.882302:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524058496:12345-0@lo:101: Request processed in 694us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.882308:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1784936565.882406:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936565.882422:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.882461:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.882466:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.882476:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.882483:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.882489:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.882521:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.882539:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.882561:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.882568:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031c00/0x6cf7a864723f579a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6cf7a864723f57a1 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.882584:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936565.882587:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936565.882588:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936565.882597:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784936565.882614:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524058624:0@lo:103: 00000100:00100000:0.0:1784936565.882682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.882730:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058624 00000100:00100000:0.0:1784936565.882742:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058624 00000100:00100000:0.0:1784936565.882784:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936565.882792:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+13:3308:x1871641524058624:12345-0@lo:103: 00010000:00010000:0.0:1784936565.882805:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936565.882818:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f57a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f579a expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.882829:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936565.882854:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+12:3308:x1871641524058624:12345-0@lo:103: Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.882861:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936565.883204:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524058624:0@lo:103: 00000100:00100000:1.0:1784936565.883290:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058496:0@lo:101: 00010000:00010000:1.0:1784936565.883307:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.883317:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.883486:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058752:0@lo:501: 00000100:00100000:1.0:1784936565.883535:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.883561:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.883873:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058752 00000100:00100000:0.0:1784936565.883879:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058752 00000100:00100000:0.0:1784936565.884000:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784936565.884009:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524058752:12345-0@lo:501: 00000100:00100000:0.0:1784936565.884461:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524058752:12345-0@lo:501: Request processed in 418us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.884472:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784936565.884993:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058752:0@lo:501: 00000100:00100000:1.0:1784936565.885052:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058880:0@lo:503: 00000100:00100000:1.0:1784936565.885113:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.885200:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.885248:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524058880 00000100:00100000:0.0:1784936565.885255:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524058880 00000100:00100000:0.0:1784936565.885334:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784936565.885342:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524058880:12345-0@lo:503: 00000100:00100000:0.0:1784936565.885701:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524058880:12345-0@lo:503: Request processed in 358us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.885709:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784936565.885877:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524058880:0@lo:503: 00000040:00080000:1.0:1784936565.886326:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784936565.886417:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059008:0@lo:502: 00000100:00100000:1.0:1784936565.886501:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.886621:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.886856:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059008 00000100:00100000:0.0:1784936565.886871:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059008 00000100:00100000:0.0:1784936565.886923:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784936565.886933:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524059008:12345-0@lo:502: 00000100:00100000:0.0:1784936565.887155:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524059008:12345-0@lo:502: Request processed in 222us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.887163:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784936565.887317:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059008:0@lo:502: 00000040:00080000:1.0:1784936565.887719:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784936565.887778:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784936565.887814:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784936565.887861:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784936565.887907:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784936565.887940:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784936565.887977:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059136:0@lo:502: 00000100:00100000:1.0:1784936565.888040:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.888068:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.888412:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059136 00000100:00100000:3.0:1784936565.888420:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059136 00000100:00100000:3.0:1784936565.888506:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784936565.888515:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524059136:12345-0@lo:502: 00000100:00100000:3.0:1784936565.888750:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524059136:12345-0@lo:502: Request processed in 234us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.888758:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784936565.889054:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059136:0@lo:502: 00000040:00080000:1.0:1784936565.889189:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784936565.889204:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1784936565.889811:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784936565.889823:0:7499:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1784936565.889832:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936565.889835:0:7499:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784936565.889842:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784936565.889867:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9096fb8dcd40) 00000020:00000080:0.0:1784936565.889968:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784936565.889977:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784936565.890059:0:7499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096ffa3c000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784936565.890069:0:7499:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784936565.890076:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6cf7a864723f57bd 00010000:00010000:0.0:1784936565.895018:0:7499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1784936565.895414:0:7499:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1784936565.902045:0:7499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1784936565.903108:0:7499:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1784936565.910266:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1784936565.910829:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784936565.915611:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784936565.915630:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936565.915638:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936565.915641:0:7499:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784936565.915645:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936565.915649:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936565.915792:0:7499:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784936565.915801:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784936565.915803:0:7499:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784936565.915889:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936565.915893:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936565.915895:0:7499:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784936565.915899:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784936565.916047:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1784936565.916099:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784936565.916133:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.916167:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936565.916176:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ffa3c000 from 1 10000000:01000000:1.0:1784936565.916179:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784936565.916390:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.916399:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.916410:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.916496:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059264:0@lo:101: 00000100:00100000:1.0:1784936565.916579:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.916630:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.916666:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059264 00000100:00100000:3.0:1784936565.916681:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059264 00000100:00100000:3.0:1784936565.916761:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784936565.916774:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:7491:x1871641524059264:12345-0@lo:101: 00010000:00010000:3.0:1784936565.916797:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936565.916819:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f57c4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.916855:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.916885:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.916895:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4200, rc 0) 00000100:00100000:3.0:1784936565.916979:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059264:12345-0@lo:101: Request processed in 207us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.916987:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784936565.917065:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059264:0@lo:101: 00010000:00010000:1.0:1784936565.917085:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.917095:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.917385:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059392:0@lo:501: 00000100:00100000:1.0:1784936565.917418:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.917565:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.917626:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059392 00000100:00100000:0.0:1784936565.917635:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059392 00000100:00100000:0.0:1784936565.917686:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784936565.917695:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059392:12345-0@lo:501: 00000100:00100000:0.0:1784936565.918043:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059392:12345-0@lo:501: Request processed in 345us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.918053:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784936565.918084:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059392:0@lo:501: 00000100:00100000:1.0:1784936565.918259:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059520:0@lo:503: 00000100:00100000:1.0:1784936565.918383:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.918409:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.918510:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059520 00000100:00100000:0.0:1784936565.918518:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059520 00000100:00100000:0.0:1784936565.918566:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784936565.918575:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059520:12345-0@lo:503: 00000100:00100000:0.0:1784936565.919220:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059520:12345-0@lo:503: Request processed in 643us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.919231:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784936565.919393:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059520:0@lo:503: 00000040:00080000:1.0:1784936565.920394:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784936565.921647:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059648:0@lo:502: 00000100:00100000:1.0:1784936565.921852:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.921927:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.921950:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059648 00000100:00100000:3.0:1784936565.921967:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059648 00000100:00100000:3.0:1784936565.923009:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784936565.923028:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059648:12345-0@lo:502: 00000100:00100000:3.0:1784936565.923417:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059648:12345-0@lo:502: Request processed in 395us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.923454:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784936565.924626:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059648:0@lo:502: 00000040:00080000:3.0:1784936565.925203:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784936565.925282:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784936565.925335:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059776:0@lo:502: 00000100:00100000:3.0:1784936565.925567:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.925658:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca240 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.925881:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059776 00000100:00100000:0.0:1784936565.925956:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059776 00000100:00100000:0.0:1784936565.926047:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784936565.926059:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059776:12345-0@lo:502: 00000100:00100000:0.0:1784936565.926312:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059776:12345-0@lo:502: Request processed in 254us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.926320:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784936565.926444:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059776:0@lo:502: 00000040:00080000:3.0:1784936565.926591:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1784936565.926609:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784936565.927683:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784936565.927698:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936565.927701:0:7503:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784936565.927710:0:7503:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096ffa3c000 00000020:00000080:2.0:1784936565.927714:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784936565.928199:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784936565.928205:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936565.928207:0:7503:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784936565.928211:0:7503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1784936565.928306:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784936565.928334:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784936565.928362:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.928389:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936565.928475:0:7491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784936565.928479:0:7491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9096ffa3c000 10000000:01000000:3.0:1784936565.928482:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9096ffa3c000 10000000:01000000:3.0:1784936565.928488:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784936565.928494:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096ffa3c000 from 1 10000000:01000000:3.0:1784936565.928498:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784936565.928557:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.928566:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.928578:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936565.928607:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059904:0@lo:101: 00000100:00100000:3.0:1784936565.928683:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936565.928717:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524059904 00000100:00100000:2.0:1784936565.928726:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524059904 00000100:00100000:3.0:1784936565.928749:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936565.928852:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784936565.928934:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524059904:12345-0@lo:101: 00010000:00010000:2.0:1784936565.928952:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936565.928969:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f57d2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.928999:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.929012:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936565.929144:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165a400, rc 0) 00000100:00100000:2.0:1784936565.929206:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524059904:12345-0@lo:101: Request processed in 276us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936565.929221:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784936565.929373:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524059904:0@lo:101: 00010000:00010000:3.0:1784936565.929392:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.929401:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936565.929576:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060032:0@lo:501: 00000100:00100000:3.0:1784936565.929625:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.929670:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.930755:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060032 00000100:00100000:0.0:1784936565.930768:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060032 00000100:00100000:0.0:1784936565.931025:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784936565.931037:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060032:12345-0@lo:501: 00000100:00100000:0.0:1784936565.931614:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060032:12345-0@lo:501: Request processed in 578us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.931636:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784936565.932281:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060032:0@lo:501: 00000100:00100000:3.0:1784936565.932351:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060160:0@lo:503: 00000100:00100000:3.0:1784936565.935995:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.936222:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.936687:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060160 00000100:00100000:3.0:1784936565.936700:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060160 00000100:00100000:0.0:1784936565.936971:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784936565.936988:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060160:12345-0@lo:503: 00000100:00100000:0.0:1784936565.937959:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060160:12345-0@lo:503: Request processed in 568us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.937973:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784936565.938144:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060160:0@lo:503: 00000040:00080000:3.0:1784936565.938962:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784936565.939152:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060288:0@lo:502: 00000100:00100000:3.0:1784936565.939236:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.939292:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.939418:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060288 00000100:00100000:0.0:1784936565.939459:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060288 00000100:00100000:0.0:1784936565.939505:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784936565.939515:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060288:12345-0@lo:502: 00000100:00100000:0.0:1784936565.940066:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060288:12345-0@lo:502: Request processed in 549us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.940075:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784936565.940228:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060288:0@lo:502: 00000040:00080000:3.0:1784936565.942278:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784936565.942391:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784936565.942498:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784936565.942587:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784936565.942629:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784936565.942709:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784936565.942749:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784936565.942931:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784936565.942989:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784936565.943026:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784936565.943061:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784936565.943193:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784936565.943232:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784936565.943265:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784936565.943311:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784936565.943368:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784936565.943404:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784936565.943726:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784936565.943768:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784936565.943941:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784936565.944012:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784936565.944051:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784936565.944149:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784936565.944199:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784936565.944230:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1784936565.944259:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1784936565.944315:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1784936565.944352:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1784936565.944609:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1784936565.944661:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1784936565.944700:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1784936565.944753:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1784936565.944947:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1784936565.945008:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1784936565.945048:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1784936565.945176:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1784936565.945216:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1784936565.945284:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060416:0@lo:502: 00000100:00100000:3.0:1784936565.945393:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.945559:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.945631:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060416 00000100:00100000:0.0:1784936565.945641:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060416 00000100:00100000:0.0:1784936565.945749:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784936565.945761:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060416:12345-0@lo:502: 00000100:00100000:0.0:1784936565.946150:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524060416:12345-0@lo:502: Request processed in 320us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.946159:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784936565.946351:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524060416:0@lo:502: 00000040:00080000:1.0:1784936565.947106:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1784936565.947126:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784936565.949788:0:7504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784936565.949806:0:7504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9096ff883380) 00000020:00000080:1.0:1784936565.949829:0:7504:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1784936565.950026:0:7504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096ffa3c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784936565.950030:0:7504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096ffa3c000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784936565.950034:0:7504:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096ffa3c000 3 00010000:00080000:1.0:1784936565.950072:0:7504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096ef1eb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.101@tcp at head 00010000:00010000:0.0:1784936565.958362:0:7504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1784936565.958503:0:7504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1784936565.958553:0:7504:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784936565.958565:0:7504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6cf7a864723f57e7 00000100:00080000:0.0:1784936565.958576:0:7504:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784936565.958582:0:7504:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9096ef1eb000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936565.958625:0:7504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096c7cad880 x1871641524060544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784936565.958660:0:7504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784936565.961417:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524060672:0@lo:400: 00000100:00100000:0.0:1784936565.961506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.961616:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524060928:0@lo:400: 00000100:00100000:3.0:1784936565.961649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.961701:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936565.961707:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524060800:0@lo:400: 00000100:00100000:3.0:1784936565.961733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.961756:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524060544:0@lo:38: 00000100:00100000:3.0:1784936565.961779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.961816:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060672 00000100:00100000:3.0:1784936565.961823:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060672 00000100:00100000:3.0:1784936565.961858:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060800 00000100:00100000:3.0:1784936565.961860:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060800 00000100:00100000:3.0:1784936565.961879:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060544 00000100:00100000:3.0:1784936565.961881:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060544 00000100:00100000:3.0:1784936565.961892:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784936565.961899:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524060672:12345-0@lo:400: 00000100:00100000:3.0:1784936565.962109:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524060672:12345-0@lo:400: Request processed in 48us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.962118:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784936565.962134:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784936565.962140:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524060800:12345-0@lo:400: 00000100:00100000:3.0:1784936565.962170:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524060800:12345-0@lo:400: Request processed in 31us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.962175:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784936565.962184:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936565.962188:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524060544:12345-0@lo:38: 00010000:00080000:3.0:1784936565.962208:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1784936565.962239:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6cf7a864723f57ee 00000004:00100000:3.0:1784936565.962254:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784936565.962295:0:5796:0:(import.c:65:import_set_state_nolock()) ffff9096ef1e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936565.962333:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1871641524060544:12345-0@lo:38: Request processed in 143us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.962339:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784936565.962374:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4ac1180 x1871641524060800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936565.962387:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524060800:0@lo:400: 00010000:00080000:3.0:1784936565.962408:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096c7cad880 x1871641524060544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784936575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936565.962415:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784936565.962421:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1784936565.962450:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784936565.962455:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784936565.962457:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784936565.962462:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524060544:0@lo:38: 00000100:00100000:0.0:1784936565.962589:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524060928 00000100:00100000:0.0:1784936565.962594:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524060928 00000100:00100000:0.0:1784936565.962630:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936565.962636:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524060928:12345-0@lo:400: 00000100:00100000:0.0:1784936565.962684:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524060928:12345-0@lo:400: Request processed in 41us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.962691:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784936565.962722:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4ac2d80 x1871641524060672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936565.962731:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524060672:0@lo:400: 00000040:00080000:0.0:1784936565.962871:0:7504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1784936565.963158:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1871641524061056:0@lo:901: 00000100:00100000:0.0:1784936565.963189:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.963215:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061056 00000100:00100000:0.0:1784936565.963218:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061056 00000100:00100000:0.0:1784936565.963240:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936565.963246:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1871641524061056:12345-0@lo:901: 00000100:00100000:0.0:1784936565.963593:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1871641524061056:12345-0@lo:901: Request processed in 346us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.963600:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936565.963620:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c830c300 going to sleep for 11 seconds 00010000:00080000:0.0:1784936565.963641:0:7506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096c7caf800 x1871641524061056/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784936581 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936565.963650:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1871641524061056:0@lo:901: 00010000:00080000:3.0:1784936565.964075:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f4ac0000 x1871641524060928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936565.964085:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524060928:0@lo:400: 00000020:01000000:3.0:1784936565.964109:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1784936565.964135:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784936565.964160:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.964170:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784936565.964213:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784936565.964218:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784936565.964219:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784936565.964220:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784936565.964221:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784936565.964222:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784936565.964223:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784936565.964225:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784936565.964226:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784936565.964227:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784936565.964228:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784936565.964232:0:7491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1784936565.964234:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784936565.964235:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784936565.964236:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784936565.964237:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784936565.964238:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784936565.964239:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784936565.964240:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784936565.964241:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784936565.964241:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784936565.964242:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784936565.964243:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784936565.964259:0:7491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784936565.964269:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524061184:0@lo:253: 00000100:00100000:3.0:1784936565.964316:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936565.964333:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c5eca240 going to sleep for 11 seconds 00000100:00100000:0.0:1784936565.965485:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061184 00000100:00100000:0.0:1784936565.965494:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061184 00000100:00100000:0.0:1784936565.965550:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784936565.965560:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7491:x1871641524061184:12345-0@lo:253: 20000000:01000000:0.0:1784936565.965587:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784936565.965599:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1784936565.966169:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936565.966176:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1784936565.996547:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784936565.996569:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784936565.996643:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784936565.996649:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784936565.996675:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.996692:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f573f expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.996701:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.996763:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f573f expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936565.996779:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f573f expref: 14 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936565.996792:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871641524061312:0@lo:104: 00000100:00100000:1.0:1784936565.996861:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936565.996927:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936565.997264:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061312 00000100:00100000:3.0:1784936565.997273:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061312 00000100:00100000:3.0:1784936565.997326:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784936565.997336:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:5812:x1871641524061312:12345-0@lo:104: 00010000:00010000:3.0:1784936565.997350:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936565.997415:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936565.997422:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:5812:x1871641524061312:12345-0@lo:104: Request processed in 87us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936565.997463:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1784936565.997533:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936565.997541:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997549:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4e00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936565.997553:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997562:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936565.997569:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936565.997575:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936565.997618:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997624:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936565.997650:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997656:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4e00/0x6cf7a864723f573f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5746 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997682:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936565.997685:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936565.997687:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936565.997699:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524061440:0@lo:103: 00000100:00100000:0.0:1784936565.997746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936565.997787:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061440 00000100:00100000:0.0:1784936565.997791:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061440 00010000:00010000:0.0:1784936565.997809:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f573f expref: 15 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936565.997828:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936565.997835:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+15:3307:x1871641524061440:12345-0@lo:103: 00010000:00010000:0.0:1784936565.997845:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936565.997851:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f573f expref: 15 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997863:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f573f expref: 15 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997878:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997886:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784936565.997921:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003527537s 00010000:00010000:0.0:1784936565.997926:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997933:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.997940:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998110:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998118:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936565.998121:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998129:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998139:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998149:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936565.998181:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+15:3307:x1871641524061440:12345-0@lo:103: Request processed in 346us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936565.998188:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936565.998254:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524061440:0@lo:103: 00010000:00010000:0.0:1784936565.998283:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031200/0x6cf7a864723f5746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f573f expref: 14 pid: 5791 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936565.998305:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1871641524061312:0@lo:104: 00010000:00010000:0.0:1784936565.998318:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998327:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998332:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936565.998338:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f57f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936566.011485:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:7491:x1871641524061184:12345-0@lo:253: Request processed in 45917us (47158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936566.011500:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784936566.011677:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b62e4f62-8046-4b06-8586-527734139351:7491:1871641524061184:0@lo:253: 10000000:01000000:3.0:1784936566.011693:0:7491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784936566.011697:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784936566.011699:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784936566.011700:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784936566.011701:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784936566.011702:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784936566.011703:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784936566.011705:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784936566.011706:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784936566.011708:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784936566.011782:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784936566.011784:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784936566.011801:0:7491:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784936566.018684:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936566.019185:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784936566.019401:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936566.019655:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784936566.020071:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936566.020345:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784936566.021681:0:7491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1784936566.091812:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784936566.269788:0:7491:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784936566.269798:0:7491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784936566.269837:0:7491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784936566.270004:0:7491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784936566.270034:0:7491:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784936566.270065:0:7491:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1784936566.677885:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524061568:0@lo:13: 00000100:00100000:0.0:1784936566.677974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936566.683179:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061568 00000100:00100000:2.0:1784936566.683193:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061568 00000100:00100000:2.0:1784936566.683262:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784936566.683273:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524061568:12345-0@lo:13: 00002000:00000024:2.0:1784936566.683318:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936566.683415:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524061568:12345-0@lo:13: Request processed in 143us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936566.683422:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784936566.685525:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac1f80 x1871641524061568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936566.685558:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524061568:0@lo:13: 00010000:00010000:1.0:1784936567.114053:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936568.138904:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936569.164837:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936570.185187:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936571.209255:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936571.276606:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524061824:0@lo:400: 00000100:00100000:0.0:1784936571.276704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936571.276790:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784936571.277114:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524061696:0@lo:400: 00000100:00100000:0.0:1784936571.277164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936571.277193:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524062208:0@lo:400: 00000100:00100000:0.0:1784936571.277237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936571.277267:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524061952:0@lo:400: 00000100:00100000:0.0:1784936571.277314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936571.277335:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936571.277341:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524062080:0@lo:400: 00000100:00100000:0.0:1784936571.277368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936571.277409:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061824 00000100:00100000:0.0:1784936571.277461:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061824 00000100:00100000:0.0:1784936571.277676:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062208 00000100:00100000:0.0:1784936571.277680:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062208 00000100:00100000:0.0:1784936571.277704:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061952 00000100:00100000:0.0:1784936571.277707:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061952 00000100:00100000:0.0:1784936571.277789:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936571.277907:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524061824:12345-0@lo:400: 00000100:00100000:0.0:1784936571.278039:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524061824:12345-0@lo:400: Request processed in 135us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936571.278048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936571.278068:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936571.278075:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524062208:12345-0@lo:400: 00000100:00100000:0.0:1784936571.278102:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524062208:12345-0@lo:400: Request processed in 28us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936571.278109:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936571.280088:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784936571.280109:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524061952:12345-0@lo:400: 00000100:00100000:0.0:1784936571.281351:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524061952:12345-0@lo:400: Request processed in 1239us (4026us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936571.281366:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784936571.281556:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524061696 00000100:00100000:0.0:1784936571.281569:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524061696 00000100:00100000:0.0:1784936571.281621:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784936571.281630:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:3306:x1871641524061696:12345-0@lo:400: 00000100:00100000:0.0:1784936571.281670:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:3306:x1871641524061696:12345-0@lo:400: Request processed in 41us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936571.281677:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784936571.281724:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062080 00000100:00100000:0.0:1784936571.281728:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062080 00000100:00100000:0.0:1784936571.281761:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936571.281769:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524062080:12345-0@lo:400: 00000100:00100000:0.0:1784936571.281813:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524062080:12345-0@lo:400: Request processed in 45us (4445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936571.281820:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784936571.287129:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c7caf480 x1871641524062080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936571.287153:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524062080:0@lo:400: 00010000:00080000:1.0:1784936571.287170:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c7cadc00 x1871641524061952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936571.287180:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524061952:0@lo:400: 00000100:00100000:1.0:1784936571.287230:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524061696:0@lo:400: 00010000:00080000:1.0:1784936571.287252:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c7cad180 x1871641524062208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936571.287262:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524062208:0@lo:400: 00010000:00080000:1.0:1784936571.287304:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c7cace00 x1871641524061824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936571.287312:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524061824:0@lo:400: 00000100:00080000:0.0:1784936571.291097:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936571.291111:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936571.786551:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936571.786589:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524062336:0@lo:13: 00000100:00100000:1.0:1784936571.786684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936571.789566:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062336 00000100:00100000:2.0:1784936571.789590:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062336 00000100:00100000:2.0:1784936571.789671:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936571.789695:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524062336:12345-0@lo:13: 00002000:00000024:2.0:1784936571.789757:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936571.789983:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524062336:12345-0@lo:13: Request processed in 299us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936571.790013:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784936571.790310:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac3800 x1871641524062336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936571.790339:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524062336:0@lo:13: 00010000:00010000:3.0:1784936572.232696:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784936572.809876:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784936572.810083:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096f4d33000 from 30 10000000:01000000:0.0:1784936572.810091:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784936572.810164:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.810179:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.810194:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936572.810228:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524062464:0@lo:101: 00000100:00100000:0.0:1784936572.810328:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936572.810414:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.810852:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062464 00000100:00100000:2.0:1784936572.810880:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062464 00000100:00100000:2.0:1784936572.810951:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784936572.810963:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524062464:12345-0@lo:101: 00010000:00010000:2.0:1784936572.811102:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936572.811123:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f57fc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.811155:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.811168:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.811179:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165ac00, rc 0) 00000100:00100000:2.0:1784936572.811250:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524062464:12345-0@lo:101: Request processed in 288us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.811257:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784936572.814217:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524062464:0@lo:101: 00010000:00010000:1.0:1784936572.814265:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.814282:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936572.814425:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524062592:0@lo:501: 00000100:00100000:1.0:1784936572.814532:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.814578:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.818073:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062592 00000100:00100000:2.0:1784936572.818091:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062592 00000100:00100000:2.0:1784936572.818184:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784936572.818197:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524062592:12345-0@lo:501: 00000100:00100000:2.0:1784936572.818773:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524062592:12345-0@lo:501: Request processed in 577us (4239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.818783:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784936572.821137:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524062592:0@lo:501: 00000100:00100000:1.0:1784936572.821220:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524062720:0@lo:503: 00000100:00100000:1.0:1784936572.821332:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.821382:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.822018:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062720 00000100:00100000:2.0:1784936572.822030:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062720 00000100:00100000:2.0:1784936572.822126:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784936572.822137:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524062720:12345-0@lo:503: 00000100:00100000:2.0:1784936572.822675:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524062720:12345-0@lo:503: Request processed in 539us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.822684:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784936572.822805:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524062720:0@lo:503: 00000100:00100000:1.0:1784936572.826879:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7788:1871641524062848:0@lo:502: 00000100:00100000:1.0:1784936572.827177:0:7788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.827240:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0300 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.829078:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062848 00000100:00100000:2.0:1784936572.829099:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062848 00000100:00100000:2.0:1784936572.829177:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784936572.829190:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:7788:x1871641524062848:12345-0@lo:502: 00000100:00100000:1.0:1784936572.836473:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7788:1871641524062848:0@lo:502: 00000100:00100000:2.0:1784936572.837328:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:7788:x1871641524062848:12345-0@lo:502: Request processed in 8134us (10144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.837347:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784936572.838222:0:7788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7788:1871641524062976:0@lo:502: 00000100:00100000:1.0:1784936572.838329:0:7788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.839110:0:7788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0300 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.845205:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524062976 00000100:00100000:2.0:1784936572.845231:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524062976 00000100:00100000:2.0:1784936572.845325:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784936572.845340:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7788:x1871641524062976:12345-0@lo:502: 00000100:00100000:2.0:1784936572.846343:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:7788:x1871641524062976:12345-0@lo:502: Request processed in 1000us (8009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.846356:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784936572.847001:0:7788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7788:1871641524062976:0@lo:502: 00000040:00080000:0.0:1784936572.847088:0:7788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784936572.851861:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784936572.851933:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784936572.851948:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.851964:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936572.851977:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784936572.851993:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784936572.851997:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784936572.852054:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.852063:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.852077:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936572.852108:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063104:0@lo:101: 00000100:00100000:2.0:1784936572.852203:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936572.852262:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4652900 going to sleep for 11 seconds 00000100:00100000:0.0:1784936572.852962:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063104 00000100:00100000:0.0:1784936572.852975:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063104 00000100:00100000:0.0:1784936572.853046:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784936572.853057:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524063104:12345-0@lo:101: 00010000:00010000:0.0:1784936572.853078:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936572.853100:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f580a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.853132:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f580a expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.853145:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f580a expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.853156:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0031c00, rc 0) 00000100:00100000:0.0:1784936572.853222:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524063104:12345-0@lo:101: Request processed in 167us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936572.853230:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784936572.853298:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063104:0@lo:101: 00010000:00010000:0.0:1784936572.853318:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.853328:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936572.853450:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063232:0@lo:501: 00000100:00100000:0.0:1784936572.853483:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936572.853499:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.853702:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063232 00000100:00100000:2.0:1784936572.853708:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063232 00000100:00100000:2.0:1784936572.853756:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784936572.853765:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524063232:12345-0@lo:501: 00000100:00100000:2.0:1784936572.854316:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524063232:12345-0@lo:501: Request processed in 551us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.854326:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784936572.855043:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063232:0@lo:501: 00000100:00100000:0.0:1784936572.855100:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063360:0@lo:503: 00000100:00100000:0.0:1784936572.855175:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936572.855211:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936572.855232:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063360 00000100:00100000:0.0:1784936572.855237:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063360 00000100:00100000:0.0:1784936572.855278:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784936572.855287:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524063360:12345-0@lo:503: 00000100:00100000:0.0:1784936572.858229:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524063360:12345-0@lo:503: Request processed in 2928us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936572.858249:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784936572.866554:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063360:0@lo:503: 00000100:00100000:1.0:1784936572.867560:0:7789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7789:1871641524063488:0@lo:502: 00000100:00100000:1.0:1784936572.867682:0:7789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.867743:0:7789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.867819:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063488 00000100:00100000:2.0:1784936572.867828:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063488 00000100:00100000:2.0:1784936572.868002:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784936572.868014:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7789:x1871641524063488:12345-0@lo:502: 00000100:00100000:2.0:1784936572.868386:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7789:x1871641524063488:12345-0@lo:502: Request processed in 372us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.868412:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784936572.873110:0:7789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7789:1871641524063488:0@lo:502: 00000020:01000000:1.0:1784936572.873179:0:7789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936572.873196:0:7789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936572.873199:0:7789:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784936572.873207:0:7789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784936572.873209:0:7789:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784936572.873261:0:7789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7789:1871641524063616:0@lo:502: 00000100:00100000:1.0:1784936572.873356:0:7789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.873444:0:7789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.876068:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063616 00000100:00100000:2.0:1784936572.876088:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063616 00000100:00100000:2.0:1784936572.876174:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784936572.876185:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7789:x1871641524063616:12345-0@lo:502: 00000100:00100000:2.0:1784936572.876570:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:7789:x1871641524063616:12345-0@lo:502: Request processed in 384us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.876579:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784936572.876752:0:7789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7789:1871641524063616:0@lo:502: 00000020:01000000:1.0:1784936572.876794:0:7789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936572.876803:0:7789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936572.876805:0:7789:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784936572.876811:0:7789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1784936572.877114:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1784936572.877137:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784936572.877149:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.877162:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936572.877173:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784936572.877175:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096d473e000 from 30 10000000:01000000:2.0:1784936572.877178:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784936572.877216:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.877225:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.877236:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936572.877258:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063744:0@lo:101: 00000100:00100000:2.0:1784936572.877303:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936572.877344:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4652f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936572.877488:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063744 00000100:00100000:0.0:1784936572.877495:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063744 00000100:00100000:0.0:1784936572.877530:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784936572.877538:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524063744:12345-0@lo:101: 00010000:00010000:0.0:1784936572.877550:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936572.877565:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5818 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.877591:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.877602:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.877618:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0030e00, rc 0) 00000100:00100000:0.0:1784936572.877652:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524063744:12345-0@lo:101: Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936572.877658:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784936572.877796:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063744:0@lo:101: 00010000:00010000:2.0:1784936572.877810:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.877819:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936572.878174:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063872:0@lo:501: 00000100:00100000:2.0:1784936572.878203:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936572.878233:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4652f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936572.878282:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524063872 00000100:00100000:0.0:1784936572.878287:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524063872 00000100:00100000:0.0:1784936572.879024:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784936572.879036:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524063872:12345-0@lo:501: 00000100:00100000:0.0:1784936572.879372:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524063872:12345-0@lo:501: Request processed in 338us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936572.879381:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784936572.880596:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524063872:0@lo:501: 00000100:00100000:2.0:1784936572.880670:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064000:0@lo:503: 00000100:00100000:2.0:1784936572.880747:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936572.891879:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4652f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784936572.893128:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064000 00000100:00100000:1.0:1784936572.893145:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064000 00000100:00100000:1.0:1784936572.893272:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784936572.893285:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524064000:12345-0@lo:503: 00000100:00100000:1.0:1784936572.893668:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524064000:12345-0@lo:503: Request processed in 385us (12920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936572.893678:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784936572.894377:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064000:0@lo:503: 00000100:00100000:1.0:1784936572.894979:0:7790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7790:1871641524064128:0@lo:502: 00000100:00100000:1.0:1784936572.895052:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.895383:0:7790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0840 going to sleep for 11 seconds 00000100:00100000:0.0:1784936572.899843:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064128 00000100:00100000:0.0:1784936572.900360:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064128 00000100:00100000:0.0:1784936572.905191:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784936572.905230:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+16:7790:x1871641524064128:12345-0@lo:502: 00000100:00100000:1.0:1784936572.911926:0:7790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7790:1871641524064128:0@lo:502: 00000100:00100000:1.0:1784936572.912054:0:7790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7790:1871641524064256:0@lo:502: 00000100:00100000:1.0:1784936572.912170:0:7790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.912224:0:7790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0840 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.912771:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064256 00000100:00100000:2.0:1784936572.912782:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064256 00000100:00100000:2.0:1784936572.912865:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784936572.912877:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:7790:x1871641524064256:12345-0@lo:502: 00000100:00100000:0.0:1784936572.914410:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:7790:x1871641524064128:12345-0@lo:502: Request processed in 9183us (19338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936572.914425:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784936572.914834:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:7790:x1871641524064256:12345-0@lo:502: Request processed in 1957us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.914841:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784936572.917649:0:7790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7790:1871641524064256:0@lo:502: 00000040:00080000:0.0:1784936572.917847:0:7790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784936572.920674:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784936572.920734:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784936572.920750:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.920765:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936572.923565:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784936572.923579:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096d473e000 from 5 10000000:01000000:0.0:1784936572.923586:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784936572.923665:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.923680:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.923721:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936572.923757:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064384:0@lo:101: 00000100:00100000:0.0:1784936572.924546:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936572.926232:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49af00 going to sleep for 11 seconds 00000100:00100000:1.0:1784936572.927027:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064384 00000100:00100000:1.0:1784936572.927042:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064384 00000100:00100000:0.0:1784936572.930149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784936572.930167:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524064384:12345-0@lo:101: 00010000:00010000:0.0:1784936572.930192:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936572.930220:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0030000/0x6cf7a864723f582d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5826 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.930262:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0030000/0x6cf7a864723f582d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5826 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.930277:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0030000/0x6cf7a864723f582d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5826 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936572.930289:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0030000, rc 0) 00000100:00100000:0.0:1784936572.930417:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524064384:12345-0@lo:101: Request processed in 254us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936572.930455:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784936572.931796:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064384:0@lo:101: 00010000:00010000:3.0:1784936572.931829:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936572.931842:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936572.931962:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064512:0@lo:256: 00000100:00100000:3.0:1784936572.932032:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.936532:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784936572.936744:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064512 00000100:00100000:1.0:1784936572.936758:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064512 00000100:00100000:1.0:1784936572.936831:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784936572.936845:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524064512:12345-0@lo:256: 20000000:01000000:1.0:1784936572.938732:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784936572.938757:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784936572.938761:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784936572.939047:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524064512:12345-0@lo:256: Request processed in 2199us (7008us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936572.939059:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784936572.939415:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064512:0@lo:256: 10000000:01000000:3.0:1784936572.940850:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784936572.941645:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936572.941666:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936572.941679:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784936572.941683:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784936572.941687:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784936572.941743:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936572.941753:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936572.941765:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936572.941792:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064640:0@lo:101: 00000100:00100000:3.0:1784936572.941880:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.943061:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff849d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.944270:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064640 00000100:00100000:2.0:1784936572.944287:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064640 00000100:00100000:2.0:1784936572.944354:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784936572.944366:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524064640:12345-0@lo:101: 00010000:00010000:2.0:1784936572.944404:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936572.944447:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5834 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.944496:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.944508:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.944520:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165a200, rc 0) 00000100:00100000:2.0:1784936572.944613:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524064640:12345-0@lo:101: Request processed in 248us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.944620:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784936572.948581:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064640:0@lo:101: 00010000:00010000:2.0:1784936572.948632:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.948664:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936572.948913:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064768:0@lo:501: 00000100:00100000:2.0:1784936572.948996:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936572.949059:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936572.949068:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064768 00000100:00100000:3.0:1784936572.949077:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064768 00000100:00100000:3.0:1784936572.949140:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784936572.949151:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524064768:12345-0@lo:501: 00000100:00100000:3.0:1784936572.949548:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524064768:12345-0@lo:501: Request processed in 397us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.949556:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784936572.950005:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064768:0@lo:501: 00000100:00100000:2.0:1784936572.950050:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064896:0@lo:503: 00000100:00100000:2.0:1784936572.950487:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936572.950523:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.950544:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524064896 00000100:00100000:2.0:1784936572.950550:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524064896 00000100:00100000:2.0:1784936572.950596:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784936572.950605:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524064896:12345-0@lo:503: 00000100:00100000:2.0:1784936572.951465:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524064896:12345-0@lo:503: Request processed in 857us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.951475:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784936572.951539:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524064896:0@lo:503: 00000100:00100000:2.0:1784936572.963400:0:7793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7793:1871641524065024:0@lo:502: 00000100:00100000:2.0:1784936572.963543:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.963593:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065024 00000100:00100000:2.0:1784936572.963596:0:7793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1c300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936572.963605:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065024 00000100:00100000:3.0:1784936572.963675:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784936572.963688:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:7793:x1871641524065024:12345-0@lo:502: 00000100:00100000:3.0:1784936572.964304:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:7793:x1871641524065024:12345-0@lo:502: Request processed in 618us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.964313:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784936572.964486:0:7793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7793:1871641524065024:0@lo:502: 00000020:01000000:2.0:1784936572.964527:0:7793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784936572.964538:0:7793:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784936572.964546:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936572.964549:0:7793:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784936572.964554:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784936572.964558:0:7793:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:2.0:1784936572.964587:0:7793:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784936572.964591:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784936572.964610:0:7793:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9096c9b63380) 00000020:00000080:2.0:1784936572.964637:0:7793:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1784936572.964645:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784936572.964739:0:7793:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784936572.964746:0:7793:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784936572.964755:0:7793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f5849 00010000:00080000:2.0:1784936572.964793:0:7793:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096fb2db800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1784936572.965295:0:7793:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1784936572.965707:0:7793:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1784936572.965724:0:7793:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784936572.975601:0:7793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784936572.976062:0:7793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784936572.976127:0:7793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1784936572.976202:0:7793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1784936572.976838:0:7794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936572.976845:0:7794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784936572.979282:0:7793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784936572.979304:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784936572.979355:0:7793:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784936572.979397:0:7793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f5850 00000100:00080000:3.0:1784936572.979412:0:7793:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784936572.979419:0:7793:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9096fb2db800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936572.979491:0:7793:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096fb2f9c00 x1871641524065152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784936572.979525:0:7793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1784936572.979644:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524065280:0@lo:400: 00000100:00100000:3.0:1784936572.979732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.979779:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936572.979786:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524065408:0@lo:400: 00000100:00100000:3.0:1784936572.979811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.979843:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524065536:0@lo:400: 00000100:00100000:3.0:1784936572.979872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.979903:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936572.979919:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524065664:0@lo:400: 00000100:00100000:3.0:1784936572.979959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.980000:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065280 00000100:00100000:3.0:1784936572.980009:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065280 00000100:00100000:3.0:1784936572.980063:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065408 00000100:00100000:3.0:1784936572.980066:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065408 00000100:00100000:3.0:1784936572.980081:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065664 00000100:00100000:3.0:1784936572.980083:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065664 00000100:00100000:3.0:1784936572.980101:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936572.980110:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524065280:12345-0@lo:400: 00000100:00100000:3.0:1784936572.980174:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524065280:12345-0@lo:400: Request processed in 64us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.980182:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936572.980198:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784936572.980205:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524065408:12345-0@lo:400: 00000100:00100000:3.0:1784936572.980234:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524065408:12345-0@lo:400: Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.980240:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784936572.980251:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784936572.980258:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524065664:12345-0@lo:400: 00000100:00100000:3.0:1784936572.980289:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524065664:12345-0@lo:400: Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.980295:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784936572.980320:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065536 00000100:00100000:3.0:1784936572.980324:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065536 00000100:00100000:3.0:1784936572.980353:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936572.980360:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524065536:12345-0@lo:400: 00000100:00100000:3.0:1784936572.980406:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524065536:12345-0@lo:400: Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.980421:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784936572.980497:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f8380 x1871641524065664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936572.980514:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524065664:0@lo:400: 00010000:00080000:3.0:1784936572.980527:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f8a80 x1871641524065536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936572.980536:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524065536:0@lo:400: 00010000:00080000:3.0:1784936572.980568:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f9180 x1871641524065408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936572.980577:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524065408:0@lo:400: 00010000:00080000:3.0:1784936572.980586:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f8e00 x1871641524065280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936572.980594:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524065280:0@lo:400: 00000020:01000000:3.0:1784936572.980657:0:7793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936572.980663:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936572.980666:0:7793:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784936572.980669:0:7793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936572.980674:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936572.980676:0:7793:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784936572.980679:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784936572.980681:0:7793:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784936572.980717:0:7793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7793:1871641524065792:0@lo:502: 00000100:00100000:3.0:1784936572.980770:0:7793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936572.980800:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065792 00000100:00100000:3.0:1784936572.980803:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065792 00000100:00100000:3.0:1784936572.980837:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784936572.980843:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:7793:x1871641524065792:12345-0@lo:502: 00000100:00100000:3.0:1784936572.981116:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:7793:x1871641524065792:12345-0@lo:502: Request processed in 272us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936572.981123:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784936572.981175:0:7793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49af00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936572.981189:0:7793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:7793:1871641524065792:0@lo:502: 00000020:01000000:3.0:1784936572.981214:0:7793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936572.981219:0:7793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936572.981221:0:7793:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784936572.981225:0:7793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1784936572.981573:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524065152:0@lo:8: 00000100:00100000:2.0:1784936572.981624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.982194:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065152 00000100:00100000:1.0:1784936572.982205:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065152 00000100:00100000:1.0:1784936572.982242:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784936572.982249:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1871641524065152:12345-0@lo:8: 00010000:00080000:1.0:1784936572.982287:0:6598:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1784936572.982335:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f5857 00002000:00100000:1.0:1784936572.982358:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9096ef1e8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784936572.982362:0:6598:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1784936572.982368:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784936572.982579:0:6598:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784936572.982768:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784936572.982800:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9096ef1ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936572.982894:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1871641524065152:12345-0@lo:8: Request processed in 643us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936572.982903:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784936572.983037:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f9c00 x1871641524065152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784936582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936572.983050:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784936572.983060:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784936572.983071:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784936572.983076:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784936572.983079:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096fb2db800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784936572.983098:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784936572.983104:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524065152:0@lo:8: 00000004:00080000:2.0:1784936572.983137:0:7794:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784936572.983269:0:7794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238734839947ns, next at 0ns, rc = 0 00000020:01000000:1.0:1784936572.987155:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784936572.987204:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784936572.987218:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.987234:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936572.987256:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784936572.987259:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9096c8a88000 from 1 10000000:01000000:1.0:1784936572.987262:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784936572.987311:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.987320:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.987334:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936572.987362:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524065920:0@lo:101: 00000100:00100000:1.0:1784936572.987518:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.987572:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.987727:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524065920 00000100:00100000:2.0:1784936572.987736:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524065920 00000100:00100000:2.0:1784936572.987799:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784936572.987810:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524065920:12345-0@lo:101: 00010000:00010000:2.0:1784936572.987827:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936572.987844:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f585e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.989333:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f585e expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.989351:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f585e expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936572.989378:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165aa00, rc 0) 00000100:00100000:2.0:1784936572.989490:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524065920:12345-0@lo:101: Request processed in 1680us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936572.989498:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784936572.990461:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524065920:0@lo:101: 00010000:00010000:1.0:1784936572.990489:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.990502:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936572.990601:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524066048:0@lo:501: 00000100:00100000:1.0:1784936572.990649:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936572.990697:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936572.991899:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066048 00000100:00100000:2.0:1784936572.991981:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066048 00000100:00100000:2.0:1784936572.992043:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784936572.992055:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524066048:12345-0@lo:501: 00000100:00100000:2.0:1784936572.992316:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524066048:12345-0@lo:501: Request processed in 262us (1665us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784936572.992326:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784936572.992523:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524066048:0@lo:501: 10000000:01000000:1.0:1784936572.992569:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784936572.992588:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936572.992600:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784936573.066880:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1784936573.106919:0:7795:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784936573.106960:0:7795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066304:0@lo:7: 00000100:00100000:2.0:1784936573.107046:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936573.107106:0:7795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936573.107504:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524066176:0@lo:13: 00000100:00100000:3.0:1784936573.107547:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936573.107596:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066304 00000100:00100000:3.0:1784936573.107604:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066304 00000100:00100000:3.0:1784936573.107666:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784936573.107680:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7795:x1871641524066304:12345-0@lo:7: 00000100:00080000:1.0:1784936573.111925:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784936573.112029:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066176 00000100:00100000:2.0:1784936573.112047:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066176 00000100:00100000:2.0:1784936573.112131:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784936573.112143:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524066176:12345-0@lo:13: 00002000:00000024:2.0:1784936573.112192:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1784936573.112316:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524066176:12345-0@lo:13: Request processed in 174us (4767us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936573.112324:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784936573.112481:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9e300 x1871641524066176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936573.112508:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524066176:0@lo:13: 00002000:00080000:3.0:1784936573.116274:0:6595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784936573.116287:0:6595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784936573.116478:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7795:x1871641524066304:12345-0@lo:7: Request processed in 8795us (9424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936573.116491:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784936573.116795:0:7795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9ca80 x1871641524066304/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784936589 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936573.116831:0:7795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066304:0@lo:7: 00000004:00080000:2.0:1784936573.116851:0:7795:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784936573.116917:0:7795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066432:0@lo:5: 00000100:00100000:2.0:1784936573.116965:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936573.117022:0:7795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936573.117045:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066432 00000100:00100000:2.0:1784936573.117053:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066432 00000100:00100000:2.0:1784936573.117102:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784936573.117111:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7795:x1871641524066432:12345-0@lo:5: 00002000:00080000:2.0:1784936573.117143:0:6598:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784936573.117149:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784936573.117515:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7795:x1871641524066432:12345-0@lo:5: Request processed in 404us (549us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784936573.117524:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784936573.117558:0:7795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9ca80 x1871641524066432/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784936589 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936573.117570:0:7795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066432:0@lo:5: 00000004:00080000:2.0:1784936573.117579:0:7795:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784936573.117607:0:7795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066560:0@lo:700: 00000100:00100000:2.0:1784936573.117633:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936573.117653:0:7795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936573.117668:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066560 00000100:00100000:2.0:1784936573.117672:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066560 00000100:00100000:2.0:1784936573.117702:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784936573.117709:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7795:x1871641524066560:12345-0@lo:700: 00000100:00100000:2.0:1784936573.117750:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6604:1871641524066688:0@lo:700: 00000100:00100000:2.0:1784936573.117784:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936573.117802:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936573.117817:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066688 00000100:00100000:2.0:1784936573.117820:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066688 00000100:00100000:2.0:1784936573.117858:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784936573.117865:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6604:x1871641524066688:12345-0@lo:700: 00000100:00080000:2.0:1784936573.118359:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:2.0:1784936573.240293:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1784936573.253842:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6604:x1871641524066688:12345-0@lo:700: Request processed in 135961us (136040us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936573.253865:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784936573.253935:0:6604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9f100 x1871641524066688/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784936589 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936573.253957:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6604:1871641524066688:0@lo:700: 40000000:02000000:1.0:1784936573.253975:0:6604:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:3.0:1784936573.259134:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784936573.421362:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784936573.421400:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1784936573.423173:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7795:x1871641524066560:12345-0@lo:700: Request processed in 305451us (305526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936573.423200:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784936573.423292:0:7795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9ce00 x1871641524066560/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784936589 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936573.423307:0:7795:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784936573.423331:0:7795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066560:0@lo:700: 00000004:02000040:3.0:1784936573.477280:0:7795:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1784936573.487820:0:7795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066816:0@lo:5: 00000100:00100000:3.0:1784936573.487921:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936573.487981:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066816 00000100:00100000:3.0:1784936573.487990:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066816 00000100:00100000:3.0:1784936573.488078:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784936573.488088:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7795:x1871641524066816:12345-0@lo:5: 00000100:00100000:2.0:1784936573.491844:0:7795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ec180 going to sleep for 11 seconds 00002000:00080000:3.0:1784936573.508840:0:6595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784936573.508874:0:6595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784936573.521839:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7795:x1871641524066816:12345-0@lo:5: Request processed in 33681us (33847us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784936573.521857:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1784936573.522392:0:7795:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c1eae680 x1871641524066816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784936589 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936573.522417:0:7795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7795:1871641524066816:0@lo:5: 00000004:00080000:0.0:1784936573.522461:0:7795:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:1.0:1784936574.143140:0:7853:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784936574.285979:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936575.305723:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936576.329137:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936576.912370:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784936576.912415:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524066944:0@lo:13: 00000100:00100000:2.0:1784936576.912543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936576.912654:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524066944 00000100:00100000:2.0:1784936576.912665:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524066944 00000100:00100000:2.0:1784936576.912752:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784936576.912764:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524066944:12345-0@lo:13: 00002000:00000024:2.0:1784936576.912827:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936576.912885:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524066944:12345-0@lo:13: Request processed in 123us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936576.912892:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1784936576.912916:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784936576.912977:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac1500 x1871641524066944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936576.913001:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524066944:0@lo:13: 00010000:00010000:0.0:1784936577.353292:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936578.376704:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936578.451893:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524067072:0@lo:400: 00000100:00100000:3.0:1784936578.451990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936578.452057:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524067584:0@lo:400: 00000100:00100000:3.0:1784936578.452089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936578.452121:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784936578.452129:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524067200:0@lo:400: 00000100:00100000:3.0:1784936578.452156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936578.452175:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524067712:0@lo:400: 00000100:00100000:3.0:1784936578.452200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936578.452236:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524067456:0@lo:400: 00000100:00100000:3.0:1784936578.452260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936578.452310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784936578.452318:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524067328:0@lo:400: 00000100:00100000:3.0:1784936578.452343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936578.452392:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067584 00000100:00100000:3.0:1784936578.452402:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067584 00000100:00100000:3.0:1784936578.452492:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067200 00000100:00100000:3.0:1784936578.452496:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067200 00000100:00100000:3.0:1784936578.452510:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067328 00000100:00100000:3.0:1784936578.452512:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067328 00000100:00100000:3.0:1784936578.452548:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784936578.452556:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524067584:12345-0@lo:400: 00000100:00100000:3.0:1784936578.452621:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524067584:12345-0@lo:400: Request processed in 65us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936578.452628:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784936578.452647:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784936578.452653:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524067200:12345-0@lo:400: 00000100:00100000:3.0:1784936578.452698:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524067200:12345-0@lo:400: Request processed in 45us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936578.452705:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784936578.452716:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784936578.452721:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524067328:12345-0@lo:400: 00000100:00100000:3.0:1784936578.452748:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524067328:12345-0@lo:400: Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936578.452754:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784936578.452777:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067712 00000100:00100000:3.0:1784936578.452781:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067712 00000100:00100000:3.0:1784936578.452810:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067456 00000100:00100000:3.0:1784936578.452813:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067456 00000100:00100000:3.0:1784936578.452832:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936578.452837:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1871641524067712:12345-0@lo:400: 00000100:00100000:3.0:1784936578.452866:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1871641524067712:12345-0@lo:400: Request processed in 29us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936578.452871:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936578.452881:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784936578.452886:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524067456:12345-0@lo:400: 00000100:00100000:3.0:1784936578.452910:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524067456:12345-0@lo:400: Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936578.452924:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1784936578.452949:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936578.452954:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784936578.452957:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784936578.453076:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac2a00 x1871641524067200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936578.453094:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524067200:0@lo:400: 00010000:00080000:3.0:1784936578.453106:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac1500 x1871641524067712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936578.453117:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524067712:0@lo:400: 00010000:00080000:3.0:1784936578.453127:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac1880 x1871641524067584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936578.453136:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524067584:0@lo:400: 00010000:00080000:3.0:1784936578.453167:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac0380 x1871641524067328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936578.453175:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524067328:0@lo:400: 00010000:00080000:3.0:1784936578.453186:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac3480 x1871641524067456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936578.453194:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524067456:0@lo:400: 00000100:00100000:2.0:1784936578.459252:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524067840:0@lo:13: 00000100:00100000:2.0:1784936578.459465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936578.459613:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067072 00000100:00100000:2.0:1784936578.459624:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067072 00000100:00100000:2.0:1784936578.459850:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784936578.459861:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524067072:12345-0@lo:400: 00000100:00100000:2.0:1784936578.459928:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524067072:12345-0@lo:400: Request processed in 67us (7937us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936578.460213:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784936578.460229:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524067072:0@lo:400: 00000100:00100000:2.0:1784936578.460301:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067840 00000100:00100000:2.0:1784936578.460308:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067840 00000100:00100000:2.0:1784936578.460341:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784936578.460348:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524067840:12345-0@lo:13: 00002000:00000024:2.0:1784936578.460382:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936578.460457:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524067840:12345-0@lo:13: Request processed in 108us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936578.460464:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784936578.460474:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9ce00 x1871641524067840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936578.460498:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524067840:0@lo:13: 00000001:00080000:3.0:1784936578.560398:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1784936579.400747:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936580.430182:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936581.448896:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936581.883045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936581.887049:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503072640 00000100:00100000:3.0:1784936581.887073:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503072640 00000100:00100000:3.0:1784936581.887180:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:3.0:1784936581.887193:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2370:x1871641503072640:12345-192.168.204.1@tcp:250: 00010000:00080000:3.0:1784936581.887248:0:5790:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d96f7a08-a761-4b50-baa8-3dae75dc18da@192.168.204.1@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1784936581.887304:0:5790:0:(genops.c:1406:class_connect()) connect: client d96f7a08-a761-4b50-baa8-3dae75dc18da, cookie 0x6cf7a864723f586c 00000100:00080000:3.0:1784936581.887556:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9096ef1e3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936581.887646:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+5:2370:x1871641503072640:12345-192.168.204.1@tcp:250: Request processed in 454us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936581.887655:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:3.0:1784936581.899811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936581.899946:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503072512 00000100:00100000:2.0:1784936581.899960:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503072512 00000100:00100000:2.0:1784936581.900040:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:2.0:1784936581.900052:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+5:5577:x1871641503072512:12345-192.168.204.1@tcp:101: 00010000:00010000:2.0:1784936581.900077:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936581.900113:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94bc7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936581.900152:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936581.900167:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936581.900181:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19a00, rc 0) 00000100:00100000:2.0:1784936581.900280:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+6:5577:x1871641503072512:12345-192.168.204.1@tcp:101: Request processed in 229us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936581.900288:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:0.0:1784936581.909515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936581.910496:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503072768 00000100:00100000:2.0:1784936581.910514:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503072768 00000100:00100000:2.0:1784936581.910612:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:2.0:1784936581.910625:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+6:5577:x1871641503072768:12345-192.168.204.1@tcp:501: 00000100:00100000:2.0:1784936581.911140:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+6:5577:x1871641503072768:12345-192.168.204.1@tcp:501: Request processed in 516us (1651us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784936581.911151:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:0.0:1784936581.915922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936581.916030:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503072896 00000100:00100000:3.0:1784936581.916045:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503072896 00000100:00100000:3.0:1784936581.916124:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:3.0:1784936581.916136:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+6:5577:x1871641503072896:12345-192.168.204.1@tcp:101: 00010000:00010000:3.0:1784936581.916162:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936581.916188:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94bce expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936581.916236:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936581.916251:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936581.916262:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936581.916374:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+7:5577:x1871641503072896:12345-192.168.204.1@tcp:101: Request processed in 239us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936581.916383:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:3.0:1784936581.923859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936581.924056:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073024 00000100:00100000:0.0:1784936581.924071:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073024 00000100:00100000:0.0:1784936581.924154:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:0.0:1784936581.924165:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+7:5577:x1871641503073024:12345-192.168.204.1@tcp:501: 00000100:00100000:1.0:1784936581.932842:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5577:x1871641503073024:12345-192.168.204.1@tcp:501: Request processed in 8659us (8981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936581.932861:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:0.0:1784936581.943355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936581.943834:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073152 00000100:00100000:2.0:1784936581.943855:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073152 00000100:00100000:2.0:1784936581.943953:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:2.0:1784936581.943966:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5577:x1871641503073152:12345-192.168.204.1@tcp:503: 00000100:00100000:2.0:1784936581.944489:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5577:x1871641503073152:12345-192.168.204.1@tcp:503: Request processed in 522us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936581.944500:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:0.0:1784936581.958961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936581.959049:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073280 00000100:00100000:1.0:1784936581.959068:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073280 00000100:00100000:1.0:1784936581.959149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:1.0:1784936581.959160:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5596:x1871641503073280:12345-192.168.204.1@tcp:502: 00000100:00100000:1.0:1784936581.959683:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5596:x1871641503073280:12345-192.168.204.1@tcp:502: Request processed in 523us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936581.959694:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:1.0:1784936581.991511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936581.991808:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073408 00000100:00100000:3.0:1784936581.991824:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073408 00000100:00100000:3.0:1784936581.991908:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:3.0:1784936581.991920:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5596:x1871641503073408:12345-192.168.204.1@tcp:502: 00000100:00100000:3.0:1784936581.992331:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5596:x1871641503073408:12345-192.168.204.1@tcp:502: Request processed in 410us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936581.992343:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:0.0:1784936581.999868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936582.000085:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073536 00000100:00100000:2.0:1784936582.000112:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073536 00000100:00100000:2.0:1784936582.000210:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:2.0:1784936582.000230:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:5577:x1871641503073536:12345-192.168.204.1@tcp:101: 00010000:00010000:2.0:1784936582.000247:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936582.000267:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d19c00/0x6cf7a864723f5881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94bf8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936582.000295:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d19c00/0x6cf7a864723f5881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bf8 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936582.000308:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d19c00/0x6cf7a864723f5881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bf8 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936582.000318:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19c00, rc 0) 00000100:00100000:2.0:1784936582.000397:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5577:x1871641503073536:12345-192.168.204.1@tcp:101: Request processed in 169us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936582.000404:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:0.0:1784936582.013524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936582.013793:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073664 00000100:00100000:2.0:1784936582.013805:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073664 00000100:00100000:2.0:1784936582.013866:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:2.0:1784936582.013876:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5577:x1871641503073664:12345-192.168.204.1@tcp:256: 20000000:01000000:2.0:1784936582.013900:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784936582.013921:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784936582.013925:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784936582.013928:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784936582.013931:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1784936582.025123:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524067968:0@lo:13: 00000100:00100000:3.0:1784936582.025207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936582.025465:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524067968 00000100:00100000:0.0:1784936582.025473:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524067968 00000100:00100000:0.0:1784936582.025538:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784936582.025548:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524067968:12345-0@lo:13: 00002000:00000024:0.0:1784936582.025596:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936582.025645:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524067968:12345-0@lo:13: Request processed in 99us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936582.025652:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1784936582.025782:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784936582.025815:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac2680 x1871641524067968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936582.025833:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524067968:0@lo:13: 00000100:00100000:2.0:1784936582.036519:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5577:x1871641503073664:12345-192.168.204.1@tcp:256: Request processed in 22633us (22995us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936582.036534:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:0.0:1784936582.044538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936582.046911:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073792 00000100:00100000:2.0:1784936582.046925:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073792 00000100:00100000:2.0:1784936582.047109:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:2.0:1784936582.047120:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5577:x1871641503073792:12345-192.168.204.1@tcp:101: 00010000:00010000:2.0:1784936582.047139:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936582.047158:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94bff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936582.047186:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936582.047198:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936582.047207:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19600, rc 0) 00000100:00100000:2.0:1784936582.047291:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5577:x1871641503073792:12345-192.168.204.1@tcp:101: Request processed in 171us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936582.047298:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:0.0:1784936582.054151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936582.054252:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503073920 00000100:00100000:2.0:1784936582.054261:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503073920 00000100:00100000:2.0:1784936582.054320:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:2.0:1784936582.054331:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5577:x1871641503073920:12345-192.168.204.1@tcp:501: 00000100:00100000:2.0:1784936582.054666:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5577:x1871641503073920:12345-192.168.204.1@tcp:501: Request processed in 335us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936582.054674:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:1.0:1784936582.062871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936582.068100:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074048 00000100:00100000:2.0:1784936582.068117:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074048 00000100:00100000:2.0:1784936582.068195:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:2.0:1784936582.068232:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5577:x1871641503074048:12345-192.168.204.1@tcp:503: 00000100:00100000:2.0:1784936582.068669:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5577:x1871641503074048:12345-192.168.204.1@tcp:503: Request processed in 439us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936582.068678:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:0.0:1784936582.075391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936582.075537:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074176 00000100:00100000:3.0:1784936582.075548:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074176 00000100:00100000:3.0:1784936582.075966:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:3.0:1784936582.075988:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5600:x1871641503074176:12345-192.168.204.1@tcp:502: 00000100:00100000:3.0:1784936582.076286:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5600:x1871641503074176:12345-192.168.204.1@tcp:502: Request processed in 309us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936582.076294:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:0.0:1784936582.080179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936582.080303:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074304 00000100:00100000:1.0:1784936582.080314:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074304 00000100:00100000:1.0:1784936582.080375:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:1.0:1784936582.080384:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5600:x1871641503074304:12345-192.168.204.1@tcp:502: 00000100:00100000:1.0:1784936582.080687:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5600:x1871641503074304:12345-192.168.204.1@tcp:502: Request processed in 303us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936582.080696:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:1.0:1784936582.084479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936582.084663:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074432 00000100:00100000:3.0:1784936582.084672:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074432 00000100:00100000:3.0:1784936582.084740:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1784936582.084748:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2370:x1871641503074432:12345-192.168.204.1@tcp:38: 00010000:00080000:3.0:1784936582.084777:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1784936582.084835:0:5796:0:(genops.c:1406:class_connect()) connect: client 486efceb-7a20-41d5-8389-4305380725bf, cookie 0x6cf7a864723f588f 00000004:00100000:3.0:1784936582.084869:0:5796:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1784936582.084875:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1784936582.174344:0:5796:0:(import.c:65:import_set_state_nolock()) ffff9096ef1e4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936582.175099:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2370:x1871641503074432:12345-192.168.204.1@tcp:38: Request processed in 90344us (90625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936582.175113:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00010000:00010000:1.0:1784936582.472880:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936583.193284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936583.193598:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074688 00000100:00100000:3.0:1784936583.193612:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074688 00000100:00100000:3.0:1784936583.193918:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1784936583.193932:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:5577:x1871641503074688:12345-192.168.204.1@tcp:41: 00000004:00000024:3.0:1784936583.193993:0:6621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784936583.194317:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:5577:x1871641503074688:12345-192.168.204.1@tcp:41: Request processed in 376us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.194330:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1784936583.197243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936583.197353:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074560 00000100:00100000:3.0:1784936583.197366:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074560 00000100:00100000:3.0:1784936583.197475:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1784936583.197496:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:0:x1871641503074560:12345-192.168.204.1@tcp:41: 00000004:00000024:3.0:1784936583.197539:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784936583.197653:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:0:x1871641503074560:12345-192.168.204.1@tcp:41: Request processed in 168us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.197662:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936583.198848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936583.198935:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074816 00000100:00100000:0.0:1784936583.198945:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074816 00000100:00100000:0.0:1784936583.199017:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1784936583.199029:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:5577:x1871641503074816:12345-192.168.204.1@tcp:40: 00000100:00100000:0.0:1784936583.199126:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:5577:x1871641503074816:12345-192.168.204.1@tcp:40: Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936583.199135:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00080000:2.0:1784936583.205366:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936583.205829:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936583.205981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936583.206049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936583.206094:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503074944 00000100:00100000:1.0:1784936583.206108:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503074944 00000100:00100000:2.0:1784936583.206241:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075328 00000100:00100000:2.0:1784936583.206246:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075328 00000100:00100000:1.0:1784936583.206327:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1784936583.206338:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1871641503074944:12345-192.168.204.1@tcp:8: 00010000:00080000:1.0:1784936583.206381:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1784936583.206423:0:6597:0:(genops.c:1406:class_connect()) connect: client 486efceb-7a20-41d5-8389-4305380725bf, cookie 0x6cf7a864723f5896 00000100:00100000:3.0:1784936583.207146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936583.207179:0:6595:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784936583.207189:0:6595:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784936583.207345:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075072 00000100:00100000:3.0:1784936583.207354:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075072 00000100:00100000:0.0:1784936583.207365:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075200 00000100:00100000:0.0:1784936583.207372:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075200 00000100:00100000:2.0:1784936583.212347:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:2.0:1784936583.212382:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2373:x1871641503075328:12345-192.168.204.1@tcp:400: 00000100:00100000:2.0:1784936583.212528:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2373:x1871641503075328:12345-192.168.204.1@tcp:400: Request processed in 165us (6547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936583.212538:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 127 00002000:00100000:1.0:1784936583.214932:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 486efceb-7a20-41d5-8389-4305380725bf/ffff9096ef1e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784936583.214961:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784936583.215683:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784936583.215746:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096ef1ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936583.215856:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2370:x1871641503074944:12345-192.168.204.1@tcp:8: Request processed in 9516us (9804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936583.215869:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1784936583.215915:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1784936583.215923:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1871641503075072:12345-192.168.204.1@tcp:8: 00010000:00080000:1.0:1784936583.215955:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1784936583.215989:0:6597:0:(genops.c:1406:class_connect()) connect: client 486efceb-7a20-41d5-8389-4305380725bf, cookie 0x6cf7a864723f589d 00002000:00100000:1.0:1784936583.215997:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 486efceb-7a20-41d5-8389-4305380725bf/ffff9096ef1ea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784936583.216019:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784936583.219739:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784936583.219805:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096ef1ea800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936583.219914:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2370:x1871641503075072:12345-192.168.204.1@tcp:8: Request processed in 3987us (12769us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936583.219926:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1784936583.221272:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1784936583.221296:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+6:5577:x1871641503075200:12345-192.168.204.1@tcp:33: 00000004:00080000:0.0:1784936583.256368:0:5799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34974us 00000004:00200000:0.0:1784936583.308722:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784936583.308958:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+6:5577:x1871641503075200:12345-192.168.204.1@tcp:33: Request processed in 87665us (103130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936583.308971:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00010000:00010000:1.0:1784936583.496813:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936583.561197:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524068096:0@lo:400: 00000100:00100000:3.0:1784936583.561316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936583.561387:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524068608:0@lo:400: 00000100:00100000:3.0:1784936583.561461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936583.561496:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784936583.561504:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524068224:0@lo:400: 00000100:00100000:3.0:1784936583.561530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936583.561551:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524068736:0@lo:400: 00000100:00100000:3.0:1784936583.561578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936583.561606:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524068480:0@lo:400: 00000100:00100000:3.0:1784936583.561756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936583.561796:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068096 00000100:00100000:3.0:1784936583.561815:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068096 00000100:00100000:3.0:1784936583.561873:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784936583.561883:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524068096:12345-0@lo:400: 00000100:00100000:3.0:1784936583.561947:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524068096:12345-0@lo:400: Request processed in 64us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.561955:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784936583.562169:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068608 00000100:00100000:3.0:1784936583.562174:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068608 00000100:00100000:3.0:1784936583.562234:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068224 00000100:00100000:3.0:1784936583.562239:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068224 00000100:00100000:3.0:1784936583.562262:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784936583.562294:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524068608:12345-0@lo:400: 00000100:00100000:3.0:1784936583.562335:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524068608:12345-0@lo:400: Request processed in 43us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.562342:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784936583.562356:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784936583.562362:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524068224:12345-0@lo:400: 00000100:00100000:3.0:1784936583.562393:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524068224:12345-0@lo:400: Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.562399:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784936583.562527:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524068352:0@lo:400: 00000100:00100000:0.0:1784936583.562565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936583.563031:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068736 00000100:00100000:2.0:1784936583.563039:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068736 00000100:00100000:2.0:1784936583.563087:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068480 00000100:00100000:2.0:1784936583.563091:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068480 00000100:00100000:2.0:1784936583.563114:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784936583.563122:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524068736:12345-0@lo:400: 00000100:00100000:2.0:1784936583.563178:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524068736:12345-0@lo:400: Request processed in 57us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936583.563198:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784936583.563214:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936583.563220:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524068480:12345-0@lo:400: 00000100:00100000:2.0:1784936583.563254:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524068480:12345-0@lo:400: Request processed in 34us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936583.563261:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1784936583.563311:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784936583.563317:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784936583.563368:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c3800 x1871641524068224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936583.563387:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524068224:0@lo:400: 00010000:00080000:2.0:1784936583.563402:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c1180 x1871641524068736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936583.563410:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784936583.563500:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524068736:0@lo:400: 00000100:00100000:2.0:1784936583.563517:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524068096:0@lo:400: 00010000:00080000:2.0:1784936583.563529:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c2d80 x1871641524068608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936583.563538:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524068608:0@lo:400: 00000100:00100000:0.0:1784936583.565019:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524068864:0@lo:13: 00000100:00100000:0.0:1784936583.565090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936583.565144:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068864 00000100:00100000:0.0:1784936583.565154:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068864 00000100:00100000:0.0:1784936583.565581:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784936583.565594:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524068864:12345-0@lo:13: 00002000:00000024:0.0:1784936583.565627:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936583.566071:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524068864:12345-0@lo:13: Request processed in 479us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936583.566080:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936583.567256:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068352 00000100:00100000:3.0:1784936583.567272:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068352 00000100:00100000:3.0:1784936583.567340:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784936583.567350:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524068352:12345-0@lo:400: 00000100:00100000:3.0:1784936583.567542:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524068352:12345-0@lo:400: Request processed in 192us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.567555:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1784936583.567585:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784936583.567950:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9f100 x1871641524068864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936583.567981:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524068864:0@lo:13: 00010000:00080000:2.0:1784936583.568156:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c0000 x1871641524068480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936583.568171:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524068480:0@lo:400: 00010000:00080000:0.0:1784936583.568351:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c0a80 x1871641524068352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936583.568362:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524068352:0@lo:400: 00000100:00100000:2.0:1784936583.570609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936583.570924:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075456 00000100:00100000:3.0:1784936583.570936:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075456 00000100:00100000:3.0:1784936583.571154:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1784936583.571167:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:5617:x1871641503075456:12345-192.168.204.1@tcp:101: 00010000:00010000:3.0:1784936583.571207:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936583.572230:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4e00/0x6cf7a864723f58a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c29 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936583.572325:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f58ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936583.572358:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f58ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936583.572373:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f58ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936583.572623:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784936583.572628:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936583.572711:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f58ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936583.572745:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4e00/0x6cf7a864723f58a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c29 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936583.572767:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f58ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c29 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936583.572777:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d173a000) 00010000:00010000:3.0:1784936583.572779:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936583.572783:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4600, rc 0) 00000100:00100000:3.0:1784936583.572865:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+7:5617:x1871641503075456:12345-192.168.204.1@tcp:101: Request processed in 1699us (2269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936583.572873:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:1.0:1784936584.521140:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936585.545560:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936585.867890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936585.868104:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075584 00000100:00100000:3.0:1784936585.868118:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075584 00000100:00100000:3.0:1784936585.868287:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936585.868304:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+7:5670:x1871641503075584:12345-192.168.204.1@tcp:41: 00000004:00000024:3.0:1784936585.868367:0:6621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784936585.868539:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+7:5670:x1871641503075584:12345-192.168.204.1@tcp:41: Request processed in 239us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936585.868547:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:2.0:1784936585.870599:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936585.879753:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936585.879875:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075712 00000100:00100000:3.0:1784936585.879891:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075712 00000100:00100000:3.0:1784936585.880122:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936585.880135:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486efceb-7a20-41d5-8389-4305380725bf+6:5670:x1871641503075712:12345-192.168.204.1@tcp:13: 00002000:00000024:3.0:1784936585.880197:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936585.880358:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486efceb-7a20-41d5-8389-4305380725bf+6:5670:x1871641503075712:12345-192.168.204.1@tcp:13: Request processed in 224us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936585.880366:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:1.0:1784936585.880860:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936585.897716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936585.898650:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075840 00000100:00100000:3.0:1784936585.898668:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075840 00000100:00100000:3.0:1784936585.898781:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:3.0:1784936585.898793:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486efceb-7a20-41d5-8389-4305380725bf+6:5670:x1871641503075840:12345-192.168.204.1@tcp:13: 00002000:00000024:3.0:1784936585.898851:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784936585.899167:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936585.903574:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:486efceb-7a20-41d5-8389-4305380725bf+6:5670:x1871641503075840:12345-192.168.204.1@tcp:13: Request processed in 148us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936585.903855:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00010000:00010000:3.0:1784936586.572653:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784936586.702794:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000001:00100000:3.0:1784936586.708152:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000100:00100000:0.0:1784936587.145536:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524068992:0@lo:13: 00000100:00100000:0.0:1784936587.145645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936587.145741:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524068992 00000100:00100000:0.0:1784936587.145750:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524068992 00000100:00100000:0.0:1784936587.145825:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936587.145835:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524068992:12345-0@lo:13: 00002000:00000024:0.0:1784936587.145864:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936587.145917:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524068992:12345-0@lo:13: Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936587.149283:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1784936587.149344:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784936587.149411:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c0a80 x1871641524068992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936587.149474:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524068992:0@lo:13: 00000001:00100000:3.0:1784936587.202882:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00010000:00010000:1.0:1784936587.592883:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936588.217769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936588.217879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936588.217922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936588.217951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936588.218033:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076224 00000100:00100000:3.0:1784936588.218043:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076224 00000100:00100000:3.0:1784936588.218108:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076352 00000100:00100000:3.0:1784936588.218111:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076352 00000100:00100000:3.0:1784936588.218137:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1784936588.218147:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503076224:12345-192.168.204.1@tcp:400: 00000100:00100000:3.0:1784936588.218217:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503076224:12345-192.168.204.1@tcp:400: Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936588.218224:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1784936588.218251:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936588.218258:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503076352:12345-192.168.204.1@tcp:400: 00000100:00100000:3.0:1784936588.218282:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503076352:12345-192.168.204.1@tcp:400: Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936588.218288:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:0.0:1784936588.218506:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936588.218511:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936588.218701:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503075968 00000100:00100000:2.0:1784936588.218706:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503075968 00000100:00100000:3.0:1784936588.218744:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076096 00000100:00100000:3.0:1784936588.218750:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076096 00000100:00100000:3.0:1784936588.218800:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1784936588.218809:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503076096:12345-192.168.204.1@tcp:400: 00000100:00100000:2.0:1784936588.218814:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00100000:2.0:1784936588.218827:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503075968:12345-192.168.204.1@tcp:400: 00000100:00100000:3.0:1784936588.218849:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503076096:12345-192.168.204.1@tcp:400: Request processed in 41us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936588.218857:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1784936588.218867:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503075968:12345-192.168.204.1@tcp:400: Request processed in 41us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936588.218882:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00080000:0.0:1784936588.218935:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936588.618664:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936588.685932:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524069120:0@lo:13: 00000100:00100000:0.0:1784936588.686016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936588.686131:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069120 00000100:00100000:3.0:1784936588.686139:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069120 00000100:00100000:3.0:1784936588.686196:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784936588.686204:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524069120:12345-0@lo:13: 00002000:00000024:3.0:1784936588.686236:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936588.686296:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524069120:12345-0@lo:13: Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936588.686302:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1784936588.686360:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784936588.686397:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c1eae680 x1871641524069120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936588.686417:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524069120:0@lo:13: 00000100:00100000:0.0:1784936588.690668:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524069376:0@lo:400: 00000100:00100000:0.0:1784936588.690743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936588.690792:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936588.690798:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524069504:0@lo:400: 00000100:00100000:0.0:1784936588.690822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936588.690862:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069376 00000100:00100000:0.0:1784936588.690871:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069376 00000100:00100000:0.0:1784936588.690918:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069504 00000100:00100000:0.0:1784936588.690921:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069504 00000100:00100000:0.0:1784936588.690952:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784936588.690961:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524069376:12345-0@lo:400: 00000100:00100000:0.0:1784936588.691013:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524069376:12345-0@lo:400: Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936588.691019:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784936588.691038:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784936588.691044:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524069504:12345-0@lo:400: 00000100:00100000:0.0:1784936588.691073:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524069504:12345-0@lo:400: Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936588.691079:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1784936588.691114:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936588.691144:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524069504:0@lo:400: 00000100:00100000:0.0:1784936588.691154:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524069376:0@lo:400: 00000100:00100000:0.0:1784936588.691201:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524069248:0@lo:400: 00000100:00100000:1.0:1784936588.691231:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524069632:0@lo:400: 00000100:00100000:0.0:1784936588.691233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936588.691258:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524069760:0@lo:400: 00000100:00100000:1.0:1784936588.691262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936588.691277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936588.691315:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069248 00000100:00100000:0.0:1784936588.691319:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069248 00000100:00100000:0.0:1784936588.691345:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784936588.691351:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524069248:12345-0@lo:400: 00000100:00100000:0.0:1784936588.691390:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524069248:12345-0@lo:400: Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936588.691395:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784936588.691453:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524069248:0@lo:400: 00000100:00100000:1.0:1784936588.691465:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069632 00000100:00100000:1.0:1784936588.691469:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069632 00000100:00100000:0.0:1784936588.691470:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069760 00000100:00100000:0.0:1784936588.691472:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069760 00000100:00100000:0.0:1784936588.691493:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784936588.691499:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524069760:12345-0@lo:400: 00000100:00100000:0.0:1784936588.691532:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524069760:12345-0@lo:400: Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936588.691538:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1784936588.691552:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936588.691569:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524069760:0@lo:400: 00000100:00100000:1.0:1784936588.691573:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784936588.691580:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524069632:12345-0@lo:400: 00000100:00100000:1.0:1784936588.691617:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524069632:12345-0@lo:400: Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936588.691623:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784936588.691634:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f9180 x1871641524069632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936588.691645:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524069632:0@lo:400: 00000001:02000400:1.0:1784936589.148061:0:8162:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784936589.641384:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936590.667573:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936591.690555:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936592.264819:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524069888:0@lo:13: 00000100:00100000:2.0:1784936592.264909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936592.265005:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524069888 00000100:00100000:2.0:1784936592.265014:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524069888 00000100:00080000:1.0:1784936592.265085:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936592.265112:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784936592.265123:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524069888:12345-0@lo:13: 00002000:00000024:2.0:1784936592.265169:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936592.265223:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524069888:12345-0@lo:13: Request processed in 101us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936592.265231:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784936592.265279:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede56300 x1871641524069888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936592.265302:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524069888:0@lo:13: 00010000:00010000:3.0:1784936592.712707:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936593.337641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936593.337683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936593.337687:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076480 00000100:00100000:2.0:1784936593.337702:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076480 00000100:00100000:1.0:1784936593.337740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936593.337779:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936593.337784:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:2.0:1784936593.337799:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2372:x1871641503076480:12345-192.168.204.1@tcp:400: 00000100:00100000:1.0:1784936593.337816:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076736 00000100:00100000:1.0:1784936593.337822:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076736 00000100:00100000:1.0:1784936593.337872:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076864 00000100:00100000:1.0:1784936593.337875:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076864 00000100:00100000:1.0:1784936593.337902:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:2.0:1784936593.337914:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2372:x1871641503076480:12345-192.168.204.1@tcp:400: Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936593.337914:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503076736:12345-192.168.204.1@tcp:400: 00000100:00100000:2.0:1784936593.337929:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:1.0:1784936593.337958:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503076736:12345-192.168.204.1@tcp:400: Request processed in 49us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936593.337967:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1784936593.337984:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936593.337991:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503076864:12345-192.168.204.1@tcp:400: 00000100:00100000:1.0:1784936593.338673:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503076864:12345-192.168.204.1@tcp:400: Request processed in 677us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936593.338683:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936593.338710:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076608 00000100:00100000:1.0:1784936593.338717:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076608 00000100:00100000:1.0:1784936593.338763:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:1.0:1784936593.338771:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503076608:12345-192.168.204.1@tcp:400: 00000100:00100000:1.0:1784936593.338803:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503076608:12345-192.168.204.1@tcp:400: Request processed in 34us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936593.338810:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00080000:1.0:1784936593.338836:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784936593.338841:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936593.338845:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1784936593.508393:0:8311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc682add10 20000000:00000080:2.0:1784936593.508419:0:8311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9096d46a0c00 uarg=0000000000000000 20000000:01000000:2.0:1784936593.509690:0:8311:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1784936593.509695:0:8311:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1784936593.509715:0:8311:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1784936593.509722:0:8311:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1784936593.509729:0:8311:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1784936593.509749:0:8311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784936593.509751:0:8311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784936593.510042:0:8311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784936593.510045:0:8311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784936593.513972:0:8312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1784936593.515096:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1784936593.516647:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1784936593.516747:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1784936593.516772:0:8311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784936593.516776:0:8311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784936593.527021:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1784936593.527862:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1784936593.527921:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1784936593.527954:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1784936593.527970:0:8311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784936593.527974:0:8311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784936593.529406:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1784936593.530245:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1784936593.530316:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1784936593.530705:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1784936593.530722:0:8311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1784936593.530726:0:8311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784936593.538963:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1784936593.543039:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1784936593.543135:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1784936593.543168:0:8311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1784936593.543190:0:8311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784936593.543220:0:8311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543243:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543251:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543259:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543267:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f580a expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543274:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543282:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543290:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f585e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543316:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543324:0:8311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543334:0:8311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543393:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543416:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 9 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.543488:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070016:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936593.543668:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543678:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 9 pid: 5791 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.543686:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070144:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936593.543716:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f585e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543724:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f585e expref: 18 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.543751:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070272:0@lo:104: 00000100:00100000:3.0:1784936593.543805:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784936593.543842:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.543850:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 18 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.543857:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070400:0@lo:104: 00000100:00100000:3.0:1784936593.543875:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.543920:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784936593.543933:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524070272 00000100:00100000:3.0:1784936593.543940:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524070272 00000100:00100000:3.0:1784936593.543983:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524070400 00000100:00100000:3.0:1784936593.543986:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524070400 00000100:00100000:3.0:1784936593.544014:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784936593.544024:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:8311:x1871641524070272:12345-0@lo:104: 00010000:00010000:3.0:1784936593.544040:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544092:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936593.544098:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:8311:x1871641524070272:12345-0@lo:104: Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936593.544105:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784936593.544124:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784936593.544130:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524070400:12345-0@lo:104: 00010000:00010000:3.0:1784936593.544137:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544176:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784936593.544181:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524070400:12345-0@lo:104: Request processed in 52us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936593.544187:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1784936593.544227:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936593.544234:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544242:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fce00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936593.544247:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544256:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936593.544265:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936593.544271:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784936593.544306:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544312:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936593.544332:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544339:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f585e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5865 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544380:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936593.544383:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544389:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4400 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936593.544392:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544399:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936593.544405:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936593.544411:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784936593.544480:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544488:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936593.544500:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544508:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4400/0x6cf7a864723f5834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f583b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544517:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.544519:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.544521:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.544543:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544557:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 18 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.544566:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070784:0@lo:104: 00000100:00100000:3.0:1784936593.544595:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.544619:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524070784 00000100:00100000:3.0:1784936593.544623:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524070784 00000100:00100000:3.0:1784936593.544644:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936593.544650:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524070784:12345-0@lo:104: 00010000:00010000:3.0:1784936593.544658:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544688:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936593.544694:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524070784:12345-0@lo:104: Request processed in 44us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936593.544699:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1784936593.544713:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936593.544717:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544723:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165b200 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936593.544727:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544734:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936593.544739:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936593.544751:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784936593.544767:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544772:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936593.544778:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544785:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c165b200/0x6cf7a864723f5818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f581f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544797:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.544798:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.544800:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.544817:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f580a expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544825:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f580a expref: 18 pid: 5791 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.544834:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071040:0@lo:104: 00000100:00100000:3.0:1784936593.544856:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.544874:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071040 00000100:00100000:3.0:1784936593.544878:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071040 00000100:00100000:3.0:1784936593.544895:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784936593.544900:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071040:12345-0@lo:104: 00010000:00010000:3.0:1784936593.544908:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544947:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936593.544952:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071040:12345-0@lo:104: Request processed in 52us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936593.544958:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1784936593.544969:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936593.544972:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544978:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165b000 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936593.544980:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.544987:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936593.544993:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936593.545012:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784936593.545027:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545033:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936593.545040:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545047:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c165b000/0x6cf7a864723f580a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5811 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545067:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.545069:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.545070:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.545089:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545098:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 18 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.545107:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071296:0@lo:104: 00000100:00100000:3.0:1784936593.545131:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.545149:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071296 00000100:00100000:3.0:1784936593.545152:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071296 00000100:00100000:3.0:1784936593.545170:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784936593.545176:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071296:12345-0@lo:104: 00010000:00010000:3.0:1784936593.545183:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545212:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936593.545217:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071296:12345-0@lo:104: Request processed in 42us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936593.545223:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1784936593.545235:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936593.545239:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545246:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031800 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936593.545249:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545265:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936593.545272:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936593.545277:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784936593.545292:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545300:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936593.545304:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545310:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031800/0x6cf7a864723f57fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5803 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545320:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.545322:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.545324:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936593.545342:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.545350:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 18 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.545359:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071552:0@lo:104: 00000100:00100000:3.0:1784936593.545381:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.545400:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071552 00000100:00100000:3.0:1784936593.545409:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071552 00000100:00100000:2.0:1784936593.545773:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524070528:0@lo:103: 00000100:00100000:2.0:1784936593.545806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936593.545834:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524071424:0@lo:103: 00000100:00100000:2.0:1784936593.545853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936593.545873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936593.545879:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524071168:0@lo:103: 00000100:00100000:2.0:1784936593.545896:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936593.545928:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524070528 00000100:00100000:2.0:1784936593.545932:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524070528 00010000:00010000:2.0:1784936593.545962:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f585e expref: 19 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936593.545979:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071424 00000100:00100000:2.0:1784936593.545981:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071424 00010000:00010000:2.0:1784936593.545990:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 20 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936593.546015:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071168 00000100:00100000:2.0:1784936593.546017:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071168 00010000:00010000:2.0:1784936593.546030:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f580a expref: 21 pid: 5791 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936593.546044:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784936593.546050:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+21:3308:x1871641524070528:12345-0@lo:103: 00010000:00010000:2.0:1784936593.546063:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936593.546070:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f585e expref: 21 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.546080:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f585e expref: 21 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.546100:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936593.546132:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+21:3308:x1871641524070528:12345-0@lo:103: Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936593.546139:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784936593.546155:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784936593.546161:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+20:3308:x1871641524071424:12345-0@lo:103: 00010000:00010000:2.0:1784936593.546169:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936593.546173:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 20 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.546189:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 20 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.546200:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936593.546223:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+20:3308:x1871641524071424:12345-0@lo:103: Request processed in 62us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936593.546228:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784936593.546242:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784936593.546248:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524071168:12345-0@lo:103: 00010000:00010000:2.0:1784936593.546256:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936593.546260:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f580a expref: 19 pid: 5791 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.546267:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f580a expref: 19 pid: 5791 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.546275:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936593.546294:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524071168:12345-0@lo:103: Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936593.546300:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784936593.546346:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524071168:0@lo:103: 00000100:00100000:2.0:1784936593.546356:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524070528:0@lo:103: 00000100:00100000:2.0:1784936593.546363:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524071424:0@lo:103: 00010000:00010000:1.0:1784936593.547031:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936593.547231:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784936593.547250:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071552:12345-0@lo:104: 00010000:00010000:3.0:1784936593.547267:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.547380:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936593.547386:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071552:12345-0@lo:104: Request processed in 143us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.547462:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524070656:0@lo:103: 00000100:00100000:0.0:1784936593.547501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.547542:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936593.547548:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524070912:0@lo:103: 00000100:00100000:0.0:1784936593.547570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.547617:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524070656 00000100:00100000:0.0:1784936593.547624:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524070656 00010000:00010000:0.0:1784936593.547650:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 19 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.547676:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524070912 00000100:00100000:0.0:1784936593.547680:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524070912 00010000:00010000:0.0:1784936593.547691:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 20 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.547703:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784936593.547709:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+20:3305:x1871641524070656:12345-0@lo:103: 00010000:00010000:0.0:1784936593.547719:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936593.547725:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 20 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.547735:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 20 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.547751:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936593.547777:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+20:3305:x1871641524070656:12345-0@lo:103: Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.547783:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784936593.547798:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784936593.547804:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524070912:12345-0@lo:103: 00010000:00010000:0.0:1784936593.547811:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936593.547815:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 19 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.547823:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 19 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.547840:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936593.547862:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524070912:12345-0@lo:103: Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.547869:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784936593.547905:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524070912:0@lo:103: 00000100:00100000:0.0:1784936593.547915:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524070656:0@lo:103: 00010000:00010000:2.0:1784936593.548168:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936593.548176:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548197:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936593.548201:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548211:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936593.548218:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936593.548225:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784936593.548304:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548312:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936593.548338:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548346:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4a00/0x6cf7a864723f57d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57d9 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548359:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936593.548361:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936593.548372:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936593.548390:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784936593.548400:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524071680:0@lo:103: 00000100:00100000:2.0:1784936593.548453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936593.548485:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071680 00000100:00100000:2.0:1784936593.548490:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071680 00010000:00010000:2.0:1784936593.548514:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 19 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936593.548534:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784936593.548540:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524071680:12345-0@lo:103: 00010000:00010000:2.0:1784936593.548548:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936593.548552:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 19 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548561:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 19 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936593.548573:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936593.548602:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524071680:12345-0@lo:103: Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936593.548608:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784936593.548634:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524071680:0@lo:103: 00000100:00100000:3.0:1784936593.548826:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1784936593.548881:0:8311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.548895:0:8311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 18 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.548906:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071808:0@lo:104: 00000100:00100000:3.0:1784936593.548935:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.548954:0:8311:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3600 going to sleep for 11 seconds 00010000:00010000:3.0:1784936593.548971:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f5865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f585e expref: 18 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.548983:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070272:0@lo:104: 00010000:00010000:3.0:1784936593.549005:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165a200/0x6cf7a864723f583b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5834 expref: 17 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.549014:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070400:0@lo:104: 00010000:00010000:3.0:1784936593.549027:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0030e00/0x6cf7a864723f581f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5818 expref: 16 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.549048:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070784:0@lo:104: 00010000:00010000:3.0:1784936593.549062:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f5811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f580a expref: 15 pid: 5791 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.549071:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071040:0@lo:104: 00010000:00010000:3.0:1784936593.549082:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f5803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f57fc expref: 14 pid: 5790 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.549090:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071296:0@lo:104: 00010000:00010000:3.0:1784936593.549100:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165a400/0x6cf7a864723f57d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f57d2 expref: 13 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936593.549108:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071552:0@lo:104: 00000100:00100000:0.0:1784936593.549167:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071808 00000100:00100000:0.0:1784936593.549171:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071808 00000100:00100000:0.0:1784936593.549205:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784936593.549212:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071808:12345-0@lo:104: 00010000:00010000:0.0:1784936593.549224:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.549282:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936593.549289:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:8311:x1871641524071808:12345-0@lo:104: Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.549295:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784936593.549311:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936593.549317:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.549325:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936593.549328:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.549337:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936593.549351:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936593.549357:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1784936593.549632:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524071808:0@lo:104: 00010000:00010000:0.0:1784936593.549825:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.549833:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936593.549857:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.549865:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5c00/0x6cf7a864723f57a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57af expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.549881:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936593.549883:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936593.549885:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936593.549929:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524071936:0@lo:103: 00000100:00100000:2.0:1784936593.549965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.550050:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524071936 00000100:00100000:0.0:1784936593.550055:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524071936 00010000:00010000:0.0:1784936593.550074:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 13 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.550158:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784936593.550166:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c82b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+13:3306:x1871641524071936:12345-0@lo:103: 00010000:00010000:0.0:1784936593.550179:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936593.550184:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 13 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.550193:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 13 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.550213:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f57af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f57a8 expref: 13 pid: 5788 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.550223:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936593.550262:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c82b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+12:3306:x1871641524071936:12345-0@lo:103: Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.550269:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784936593.550346:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524071936:0@lo:103: 00000100:00100000:2.0:1784936593.556765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936593.556811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936593.556899:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077120 00000100:00100000:0.0:1784936593.556912:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077120 00000100:00100000:3.0:1784936593.556931:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070016:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936593.556947:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8311:1871641524070144:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936593.556964:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 10 pid: 5791 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.557024:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503076992 00000100:00100000:0.0:1784936593.557028:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503076992 00010000:00010000:3.0:1784936593.557032:0:8311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557043:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 11 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.557063:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1784936593.557073:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2371:x1871641503077120:12345-192.168.204.1@tcp:103: 00010000:00010000:0.0:1784936593.557092:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936593.557099:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 11 pid: 5791 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557109:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 11 pid: 5791 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557129:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d19a00/0x6cf7a864723f5873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bc7 expref: 11 pid: 5791 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557169:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936593.557238:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503077120:12345-192.168.204.1@tcp:103: Request processed in 165us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.557246:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1784936593.557264:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1784936593.557270:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:2372:x1871641503076992:12345-192.168.204.1@tcp:103: 00010000:00010000:0.0:1784936593.557278:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936593.557282:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 9 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557294:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 9 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557305:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f587a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bce expref: 9 pid: 5790 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557318:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557327:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557343:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557350:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557358:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557371:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557379:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936593.557383:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557391:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557411:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936593.557421:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936593.557461:0:8311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936593.557472:0:8311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.557478:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:2372:x1871641503076992:12345-192.168.204.1@tcp:103: Request processed in 206us (666us total) trans 0 rc 0/0 00010000:00010000:3.0:1784936593.557485:0:8311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936593.557489:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00010000:00010000:2.0:1784936593.742281:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936593.800657:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524072320:0@lo:400: 00000100:00100000:3.0:1784936593.800755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.800821:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936593.800827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524072448:0@lo:400: 00000100:00100000:3.0:1784936593.800855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.800926:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524072064:0@lo:400: 00000100:00100000:0.0:1784936593.800959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.800984:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524072576:0@lo:400: 00000100:00100000:0.0:1784936593.801016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.801036:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936593.801042:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524072192:0@lo:400: 00000100:00100000:0.0:1784936593.801061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936593.801089:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072448 00000100:00100000:0.0:1784936593.801097:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072448 00000100:00100000:0.0:1784936593.801152:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072064 00000100:00100000:0.0:1784936593.801154:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072064 00000100:00100000:0.0:1784936593.801182:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072192 00000100:00100000:0.0:1784936593.801186:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072192 00000100:00100000:0.0:1784936593.801215:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784936593.801226:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524072448:12345-0@lo:400: 00000100:00100000:0.0:1784936593.801289:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524072448:12345-0@lo:400: Request processed in 64us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.801296:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784936593.801313:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784936593.801318:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524072064:12345-0@lo:400: 00000100:00100000:0.0:1784936593.801345:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524072064:12345-0@lo:400: Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.801351:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784936593.801360:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784936593.801365:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524072192:12345-0@lo:400: 00000100:00100000:0.0:1784936593.801386:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524072192:12345-0@lo:400: Request processed in 21us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936593.801391:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784936593.801466:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524072192:0@lo:400: 00000100:00100000:0.0:1784936593.801480:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524072064:0@lo:400: 00000100:00100000:0.0:1784936593.801525:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524072448:0@lo:400: 00000100:00100000:1.0:1784936593.801763:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072320 00000100:00100000:1.0:1784936593.801769:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072320 00000100:00100000:1.0:1784936593.801801:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072576 00000100:00100000:1.0:1784936593.801804:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072576 00000100:00100000:1.0:1784936593.801828:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784936593.801840:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524072320:12345-0@lo:400: 00000100:00100000:1.0:1784936593.801890:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524072320:12345-0@lo:400: Request processed in 56us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936593.801897:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784936593.801910:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784936593.801916:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524072576:12345-0@lo:400: 00000100:00100000:1.0:1784936593.801948:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524072576:12345-0@lo:400: Request processed in 32us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936593.801954:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1784936593.801980:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936593.801985:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784936593.802031:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8fb80 x1871641524072576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936593.802043:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524072576:0@lo:400: 00010000:00080000:1.0:1784936593.802067:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8d180 x1871641524072320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936593.802076:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524072320:0@lo:400: 00000100:00100000:1.0:1784936593.802300:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524072704:0@lo:13: 00000100:00100000:1.0:1784936593.802339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936593.802458:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072704 00000100:00100000:3.0:1784936593.802463:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072704 00000100:00100000:3.0:1784936593.802494:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936593.802502:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524072704:12345-0@lo:13: 00002000:00000024:3.0:1784936593.802538:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936593.802582:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524072704:12345-0@lo:13: Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936593.802588:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1784936593.802657:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8d500 x1871641524072704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936593.802673:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524072704:0@lo:13: 10000000:01000000:1.0:1784936594.760589:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784936594.760601:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096ffa3c000 from 39 10000000:01000000:1.0:1784936594.760610:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784936594.760684:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.760698:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.760711:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936594.760743:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524072832:0@lo:101: 00000100:00100000:1.0:1784936594.760840:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.760925:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927900 going to sleep for 11 seconds 00000100:00100000:2.0:1784936594.761013:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072832 00000100:00100000:2.0:1784936594.761024:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072832 00000100:00100000:2.0:1784936594.761107:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784936594.761119:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+12:5793:x1871641524072832:12345-0@lo:101: 00010000:00010000:2.0:1784936594.761137:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936594.761171:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d18200/0x6cf7a864723f58c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f58b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.761203:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d18200/0x6cf7a864723f58c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f58b9 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.761215:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d18200/0x6cf7a864723f58c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f58b9 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.761227:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18200, rc 0) 00010000:00010000:0.0:1784936594.761248:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936594.761297:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524072832:12345-0@lo:101: Request processed in 180us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936594.761314:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784936594.761959:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524072832:0@lo:101: 00010000:00010000:3.0:1784936594.761993:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.762005:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936594.762083:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524072960:0@lo:501: 00000100:00100000:3.0:1784936594.762124:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.762164:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936594.764799:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524072960 00000100:00100000:2.0:1784936594.764822:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524072960 00000100:00100000:2.0:1784936594.764941:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784936594.764954:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524072960:12345-0@lo:501: 00000100:00100000:2.0:1784936594.765484:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524072960:12345-0@lo:501: Request processed in 531us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936594.765494:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784936594.765806:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524072960:0@lo:501: 00000100:00100000:3.0:1784936594.765952:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073088:0@lo:503: 00000100:00100000:3.0:1784936594.766031:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.766155:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.773556:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073088 00000100:00100000:1.0:1784936594.773579:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073088 00000100:00100000:1.0:1784936594.773680:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784936594.773693:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524073088:12345-0@lo:503: 00000100:00100000:1.0:1784936594.774063:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524073088:12345-0@lo:503: Request processed in 372us (8030us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936594.774073:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784936594.775133:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073088:0@lo:503: 00000100:00100000:3.0:1784936594.776643:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8328:1871641524073216:0@lo:502: 00000100:00100000:3.0:1784936594.776773:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.776826:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.776982:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073216 00000100:00100000:0.0:1784936594.776992:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073216 00000100:00100000:0.0:1784936594.777062:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784936594.777074:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:8328:x1871641524073216:12345-0@lo:502: 00000100:00100000:0.0:1784936594.777415:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:8328:x1871641524073216:12345-0@lo:502: Request processed in 342us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.777470:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784936594.777523:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8328:1871641524073216:0@lo:502: 00000100:00100000:3.0:1784936594.777684:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8328:1871641524073344:0@lo:502: 00000100:00100000:3.0:1784936594.778035:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.778077:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784936594.778163:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073344 00000100:00100000:2.0:1784936594.778170:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073344 00000100:00100000:2.0:1784936594.778258:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784936594.778268:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:8328:x1871641524073344:12345-0@lo:502: 00000100:00100000:2.0:1784936594.778510:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+13:8328:x1871641524073344:12345-0@lo:502: Request processed in 243us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936594.778552:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784936594.778640:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8328:1871641524073344:0@lo:502: 00000040:00080000:3.0:1784936594.778668:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784936594.779534:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784936594.779567:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784936594.779579:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.779591:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936594.779602:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784936594.779605:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1784936594.779609:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784936594.779653:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.779662:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.779674:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936594.779698:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073472:0@lo:101: 00000100:00100000:0.0:1784936594.779754:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936594.779803:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.779822:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073472 00000100:00100000:1.0:1784936594.779833:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073472 00000100:00100000:1.0:1784936594.779945:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784936594.779954:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+13:5793:x1871641524073472:12345-0@lo:101: 00010000:00010000:1.0:1784936594.779991:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936594.780007:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c13fc000/0x6cf7a864723f58ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f58c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.780038:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fc000/0x6cf7a864723f58ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f58c7 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.780052:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c13fc000/0x6cf7a864723f58ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f58c7 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.780062:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fc000, rc 0) 00000100:00100000:1.0:1784936594.780114:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524073472:12345-0@lo:101: Request processed in 160us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936594.780121:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784936594.780205:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073472:0@lo:101: 00010000:00010000:3.0:1784936594.780221:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.780232:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936594.780285:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073600:0@lo:501: 00000100:00100000:3.0:1784936594.780315:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.780334:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784936594.780397:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073600 00000100:00100000:2.0:1784936594.780402:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073600 00000100:00100000:2.0:1784936594.780450:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784936594.780455:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524073600:12345-0@lo:501: 00000100:00100000:2.0:1784936594.781203:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524073600:12345-0@lo:501: Request processed in 743us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936594.781214:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784936594.781291:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073600:0@lo:501: 00000100:00100000:3.0:1784936594.781330:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073728:0@lo:503: 00000100:00100000:3.0:1784936594.781379:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.781504:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.781532:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073728 00000100:00100000:1.0:1784936594.781806:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073728 00000100:00100000:1.0:1784936594.781951:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784936594.781961:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524073728:12345-0@lo:503: 00000100:00100000:1.0:1784936594.782169:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524073728:12345-0@lo:503: Request processed in 210us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936594.782178:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784936594.782247:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524073728:0@lo:503: 00000100:00100000:3.0:1784936594.782719:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8329:1871641524073856:0@lo:502: 00000100:00100000:3.0:1784936594.782762:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.783406:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.783829:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073856 00000100:00100000:0.0:1784936594.783838:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073856 00000100:00100000:0.0:1784936594.783897:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784936594.783907:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:8329:x1871641524073856:12345-0@lo:502: 00000100:00100000:0.0:1784936594.784200:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:8329:x1871641524073856:12345-0@lo:502: Request processed in 293us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.784215:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784936594.785158:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8329:1871641524073856:0@lo:502: 00000020:01000000:3.0:1784936594.785212:0:8329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936594.785226:0:8329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936594.785229:0:8329:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784936594.785235:0:8329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784936594.785281:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8329:1871641524073984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.785351:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.785395:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.785461:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524073984 00000100:00100000:0.0:1784936594.785467:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524073984 00000100:00100000:0.0:1784936594.785953:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784936594.785967:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:8329:x1871641524073984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936594.786220:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:8329:x1871641524073984:12345-0@lo:502:llog_process_th.0 Request processed in 256us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.786227:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784936594.786390:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8329:1871641524073984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936594.786422:0:8329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936594.786456:0:8329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936594.786459:0:8329:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784936594.786465:0:8329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1784936594.786770:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1784936594.786796:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784936594.786810:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.786824:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936594.786861:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784936594.786864:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096f4d33000 from 39 10000000:01000000:1.0:1784936594.786868:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784936594.786908:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.786916:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.786927:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936594.786946:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.786996:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.787034:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.787093:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074112 00000100:00100000:3.0:1784936594.787099:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074112 00000100:00100000:3.0:1784936594.787130:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784936594.787138:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+14:5793:x1871641524074112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936594.787150:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936594.787167:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f58d5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.787204:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f58d5 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.787216:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f58d5 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.787228:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4800, rc 0) 00000100:00100000:3.0:1784936594.787273:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524074112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.787279:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784936594.787411:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936594.787461:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.787473:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936594.787525:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.787806:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.787834:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.787884:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074240 00000100:00100000:3.0:1784936594.787888:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074240 00000100:00100000:3.0:1784936594.787909:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784936594.787916:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524074240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.788222:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524074240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.788231:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784936594.788357:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.788394:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.788477:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.788495:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.788614:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074368 00000100:00100000:3.0:1784936594.788729:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074368 00000100:00100000:3.0:1784936594.788754:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784936594.788761:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524074368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.788942:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524074368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.788949:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784936594.789083:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.789592:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8330:1871641524074496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936594.789763:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.789802:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927540 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.789943:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074496 00000100:00100000:3.0:1784936594.789949:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074496 00000100:00100000:3.0:1784936594.790004:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784936594.790012:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:8330:x1871641524074496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.790356:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:8330:x1871641524074496:12345-0@lo:502:llog_process_th.0 Request processed in 344us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.790365:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784936594.791013:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8330:1871641524074496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936594.791087:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8330:1871641524074624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936594.791135:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.791204:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927540 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.791247:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074624 00000100:00100000:3.0:1784936594.791253:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074624 00000100:00100000:3.0:1784936594.791330:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784936594.791339:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:8330:x1871641524074624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.791754:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+15:8330:x1871641524074624:12345-0@lo:502:llog_process_th.0 Request processed in 415us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.791764:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784936594.791847:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8330:1871641524074624:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784936594.791887:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784936594.792072:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784936594.792093:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784936594.792104:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.792117:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936594.792127:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784936594.792131:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784936594.792134:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784936594.792168:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.792177:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.792187:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936594.792205:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.792242:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.792587:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.792767:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074752 00000100:00100000:0.0:1784936594.792774:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074752 00000100:00100000:0.0:1784936594.792814:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784936594.792824:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+15:5793:x1871641524074752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936594.792842:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936594.792922:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f58ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f58e3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.792954:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f58ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f58e3 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.792966:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f58ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f58e3 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.792987:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0031c00, rc 0) 00000100:00100000:0.0:1784936594.793041:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524074752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.793047:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784936594.793149:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936594.793168:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.793178:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936594.793243:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.793273:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.793298:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.793347:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524074880 00000100:00100000:3.0:1784936594.793351:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524074880 00000100:00100000:3.0:1784936594.793377:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784936594.793384:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524074880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.794088:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524074880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 701us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.794097:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784936594.794172:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524074880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.794212:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.794253:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.794285:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.794336:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075008 00000100:00100000:0.0:1784936594.794348:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075008 00000100:00100000:0.0:1784936594.794384:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784936594.794392:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524075008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936594.794605:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524075008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.794612:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784936594.795050:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.795904:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8331:1871641524075136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936594.795982:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.796027:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.796136:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075136 00000100:00100000:0.0:1784936594.796144:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075136 00000100:00100000:0.0:1784936594.796192:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784936594.796201:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:8331:x1871641524075136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936594.796473:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:8331:x1871641524075136:12345-0@lo:502:llog_process_th.0 Request processed in 272us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.796482:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784936594.796583:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8331:1871641524075136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784936594.796792:0:8331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784936594.796804:0:8331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936594.796807:0:8331:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784936594.796816:0:8331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784936594.796845:0:8331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8331:1871641524075264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936594.796960:0:8331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.796994:0:8331:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.797067:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075264 00000100:00100000:3.0:1784936594.797072:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075264 00000100:00100000:3.0:1784936594.797103:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784936594.797110:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:8331:x1871641524075264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.797279:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:8331:x1871641524075264:12345-0@lo:502:llog_process_th.0 Request processed in 168us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.797286:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784936594.797732:0:8331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8331:1871641524075264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784936594.797766:0:8331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784936594.797772:0:8331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936594.797774:0:8331:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784936594.797781:0:8331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1784936594.797939:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1784936594.797962:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784936594.797985:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.798000:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936594.798013:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784936594.798017:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096d473e000 from 39 10000000:01000000:0.0:1784936594.798020:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784936594.798063:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.798072:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.798096:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936594.798117:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936594.798163:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936594.798198:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.798525:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075392 00000100:00100000:3.0:1784936594.798541:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075392 00000100:00100000:3.0:1784936594.798584:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784936594.798593:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524075392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936594.798607:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936594.798700:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f58f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f58f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.798729:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f58f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f58f1 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.798741:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f58f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f58f1 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.798751:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4400, rc 0) 00000100:00100000:3.0:1784936594.798802:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524075392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.798809:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784936594.799216:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936594.799235:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.799246:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936594.799315:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.799349:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.799384:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.799479:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075520 00000100:00100000:3.0:1784936594.799484:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075520 00000100:00100000:3.0:1784936594.799526:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784936594.799544:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524075520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.800253:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524075520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 717us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.800264:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784936594.802008:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.802095:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936594.802190:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936594.802294:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.802342:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075648 00000100:00100000:0.0:1784936594.802350:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075648 00000100:00100000:0.0:1784936594.802687:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784936594.802703:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524075648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936594.803094:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524075648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 394us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.803102:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784936594.803226:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524075648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.808356:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8332:1871641524075776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.808982:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.809330:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.809391:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075776 00000100:00100000:1.0:1784936594.809403:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075776 00000100:00100000:2.0:1784936594.809982:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784936594.810002:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:8332:x1871641524075776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936594.810421:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:8332:x1871641524075776:12345-0@lo:502:llog_process_th.0 Request processed in 425us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936594.810464:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784936594.811584:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8332:1871641524075776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.812001:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8332:1871641524075904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.812080:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.812179:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9a7cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.812302:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524075904 00000100:00100000:0.0:1784936594.812311:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524075904 00000100:00100000:0.0:1784936594.812419:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784936594.812464:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:8332:x1871641524075904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936594.813023:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:8332:x1871641524075904:12345-0@lo:502:llog_process_th.0 Request processed in 594us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.813033:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784936594.813116:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8332:1871641524075904:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784936594.813153:0:8332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784936594.813979:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784936594.814012:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784936594.814026:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.814041:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936594.814052:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784936594.814056:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1784936594.814059:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784936594.814099:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.814108:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.814133:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936594.814158:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.814215:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.814261:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.814328:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076032 00000100:00100000:3.0:1784936594.814336:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076032 00000100:00100000:3.0:1784936594.814390:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784936594.814399:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524076032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936594.814413:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936594.814449:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f5906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f58ff expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.814477:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f5906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f58ff expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.814489:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f5906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f58ff expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.814499:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4e00, rc 0) 00000100:00100000:3.0:1784936594.814544:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524076032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.814552:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784936594.814906:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936594.814923:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936594.814934:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936594.815004:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.815035:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.815066:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.815082:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076160 00000100:00100000:1.0:1784936594.815086:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076160 00000100:00100000:1.0:1784936594.815110:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784936594.815117:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524076160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.815405:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524076160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936594.815414:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784936594.815472:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.815500:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.815556:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.815571:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.815583:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076288 00000100:00100000:1.0:1784936594.815586:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076288 00000100:00100000:1.0:1784936594.815602:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784936594.815607:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524076288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.816254:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524076288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 643us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936594.816263:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784936594.816551:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.817223:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8333:1871641524076416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936594.817284:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.818059:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936594.820272:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076416 00000100:00100000:3.0:1784936594.820291:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076416 00000100:00100000:3.0:1784936594.820372:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784936594.820386:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:8333:x1871641524076416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936594.822010:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:8333:x1871641524076416:12345-0@lo:502:llog_process_th.0 Request processed in 1616us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936594.822027:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784936594.822278:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8333:1871641524076416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784936594.822335:0:8333:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936594.822348:0:8333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936594.822351:0:8333:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784936594.822359:0:8333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784936594.822410:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8333:1871641524076544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936594.822501:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936594.822551:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.822790:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076544 00000100:00100000:0.0:1784936594.822797:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076544 00000100:00100000:0.0:1784936594.822858:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784936594.822869:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:8333:x1871641524076544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936594.823139:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:8333:x1871641524076544:12345-0@lo:502:llog_process_th.0 Request processed in 271us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.823154:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784936594.823350:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8333:1871641524076544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784936594.823379:0:8333:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784936594.823385:0:8333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936594.823387:0:8333:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784936594.823395:0:8333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784936594.823633:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784936594.823666:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784936594.823679:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.823692:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936594.823704:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784936594.823706:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9096c8a88000 from 1 10000000:01000000:3.0:1784936594.823710:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784936594.823746:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.823755:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.823766:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936594.823786:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.823832:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.824078:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936594.824157:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076672 00000100:00100000:0.0:1784936594.824164:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076672 00000100:00100000:0.0:1784936594.824211:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784936594.824219:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524076672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936594.824231:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936594.824247:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f590d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.824275:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f590d expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.824286:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f590d expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936594.824296:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0031800, rc 0) 00000100:00100000:0.0:1784936594.824340:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524076672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936594.824347:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784936594.824784:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936594.824801:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936594.824811:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936594.825048:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936594.825084:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936594.825118:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1784936594.825881:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076800 00000100:00100000:1.0:1784936594.825890:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076800 00000100:00100000:1.0:1784936594.825940:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784936594.825950:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524076800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936594.826308:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524076800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (1222us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784936594.826329:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784936594.826508:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524076800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784936594.826552:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784936594.826564:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936594.826576:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936595.785589:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936596.810487:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936597.386302:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524076928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936597.386401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936597.387031:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524076928 00000100:00100000:0.0:1784936597.387043:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524076928 00000100:00100000:0.0:1784936597.387130:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784936597.387143:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524076928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936597.387198:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936597.387269:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524076928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936597.387300:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1784936597.387669:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784936597.388195:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c3100 x1871641524076928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936597.388224:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524076928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784936597.833173:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936598.455268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.455786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.455816:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.455852:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936598.455930:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077504 00000100:00100000:1.0:1784936598.455944:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077504 00000100:00100000:1.0:1784936598.456030:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:1.0:1784936598.456042:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503077504:12345-192.168.204.1@tcp:400: 00000100:00100000:1.0:1784936598.456143:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503077504:12345-192.168.204.1@tcp:400: Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936598.456163:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00080000:1.0:1784936598.456197:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936598.457932:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077760 00000100:00100000:2.0:1784936598.457953:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077760 00000100:00100000:2.0:1784936598.458058:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1784936598.458076:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503077760:12345-192.168.204.1@tcp:400: 00000100:00080000:1.0:1784936598.458106:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784936598.458165:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503077760:12345-192.168.204.1@tcp:400: Request processed in 97us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936598.458174:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:0.0:1784936598.461461:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077248 00000100:00100000:0.0:1784936598.461485:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077248 00000100:00100000:2.0:1784936598.462641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.462838:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077632 00000100:00100000:3.0:1784936598.462848:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077632 00000100:00100000:3.0:1784936598.462944:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1784936598.462957:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503077632:12345-192.168.204.1@tcp:400: 00000100:00100000:3.0:1784936598.463062:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503077632:12345-192.168.204.1@tcp:400: Request processed in 107us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936598.463088:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00080000:2.0:1784936598.464137:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936598.465556:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077376 00000100:00100000:1.0:1784936598.465577:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077376 00000100:00100000:1.0:1784936598.465740:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:1.0:1784936598.465754:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503077248:12345-192.168.204.1@tcp:101: 00010000:00010000:1.0:1784936598.465777:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936598.465805:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c13fda00/0x6cf7a864723f591b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c30 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936598.465844:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fda00/0x6cf7a864723f591b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c30 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936598.465859:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c13fda00/0x6cf7a864723f591b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c30 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936598.465870:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fda00, rc 0) 00000100:00100000:1.0:1784936598.465956:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503077248:12345-192.168.204.1@tcp:101: Request processed in 204us (10704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936598.465981:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:1.0:1784936598.466021:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 165 00000100:00100000:1.0:1784936598.466028:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:2371:x1871641503077376:12345-192.168.204.1@tcp:400: 00000100:00100000:1.0:1784936598.466058:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:2371:x1871641503077376:12345-192.168.204.1@tcp:400: Request processed in 30us (10205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936598.466065:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 165 00000100:00100000:2.0:1784936598.473720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936598.473881:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503077888 00000100:00100000:0.0:1784936598.473897:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503077888 00000100:00100000:0.0:1784936598.473986:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 166 00000100:00100000:0.0:1784936598.473998:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503077888:12345-192.168.204.1@tcp:501: 00000100:00100000:0.0:1784936598.474639:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503077888:12345-192.168.204.1@tcp:501: Request processed in 639us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936598.474650:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 166 00000100:00100000:2.0:1784936598.477607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.477724:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078016 00000100:00100000:3.0:1784936598.477742:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078016 00000100:00100000:3.0:1784936598.477826:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:3.0:1784936598.477839:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503078016:12345-192.168.204.1@tcp:503: 00000100:00100000:3.0:1784936598.478225:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503078016:12345-192.168.204.1@tcp:503: Request processed in 386us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936598.478237:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:2.0:1784936598.501844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936598.503727:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078144 00000100:00100000:0.0:1784936598.503747:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078144 00000100:00100000:0.0:1784936598.503844:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:0.0:1784936598.503856:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:6083:x1871641503078144:12345-192.168.204.1@tcp:502: 00000100:00100000:0.0:1784936598.505743:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:6083:x1871641503078144:12345-192.168.204.1@tcp:502: Request processed in 1872us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936598.505760:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:2.0:1784936598.511811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.512475:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078272 00000100:00100000:3.0:1784936598.512489:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078272 00000100:00100000:3.0:1784936598.512573:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:3.0:1784936598.512585:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:6083:x1871641503078272:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784936598.514313:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:6083:x1871641503078272:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 1716us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936598.514328:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:2.0:1784936598.527709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936598.527893:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078400 00000100:00100000:0.0:1784936598.527919:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078400 00000100:00100000:0.0:1784936598.528000:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:0.0:1784936598.528013:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503078400:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936598.528039:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936598.528064:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c0031a00/0x6cf7a864723f5922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c37 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936598.528142:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c0031a00/0x6cf7a864723f5922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c37 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936598.528176:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c0031a00/0x6cf7a864723f5922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c37 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936598.528189:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c0031a00, rc 0) 00000100:00100000:0.0:1784936598.528283:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503078400:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 272us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936598.528291:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:2.0:1784936598.531753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936598.531889:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078528 00000100:00100000:3.0:1784936598.531910:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078528 00000100:00100000:3.0:1784936598.531978:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00100000:3.0:1784936598.531989:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503078528:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936598.532567:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503078528:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 574us (825us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784936598.532578:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 171 00010000:00010000:0.0:1784936598.856733:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936598.920951:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524077056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936598.921056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936598.921374:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077056 00000100:00100000:3.0:1784936598.921385:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077056 00000100:00100000:3.0:1784936598.921485:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784936598.921511:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524077056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936598.921557:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936598.921606:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524077056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936598.921613:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1784936598.922263:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8d180 x1871641524077056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936598.922348:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524077056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784936598.922506:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936598.923531:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524077184:0@lo:400:kworker.0 00000100:00100000:1.0:1784936598.923612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936598.923715:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077184 00000100:00100000:2.0:1784936598.923724:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077184 00000100:00100000:2.0:1784936598.923790:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784936598.923800:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524077184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936598.923971:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524077312:0@lo:400:kworker.0 00000100:00100000:3.0:1784936598.924013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936598.924054:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077312 00000100:00100000:3.0:1784936598.924058:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077312 00000100:00100000:3.0:1784936598.924095:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784936598.924102:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524077312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936598.924145:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524077312:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936598.924177:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784936598.924222:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524077312:0@lo:400:kworker.0 00000100:00100000:2.0:1784936598.929588:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524077184:12345-0@lo:400:kworker.0 Request processed in 5772us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936598.929608:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784936598.929966:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524077184:0@lo:400:kworker.0 00000100:00100000:0.0:1784936598.933965:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784936598.934001:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524077696:0@lo:400:kworker.0 00000100:00100000:0.0:1784936598.934100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936598.934295:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524077568:0@lo:400:kworker.0 00000100:00100000:1.0:1784936598.934336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936598.934359:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784936598.934365:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524077440:0@lo:400:kworker.0 00000100:00100000:1.0:1784936598.934390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936598.934446:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077696 00000100:00100000:1.0:1784936598.934455:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077696 00000100:00100000:1.0:1784936598.934522:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077440 00000100:00100000:1.0:1784936598.934526:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077440 00000100:00100000:1.0:1784936598.934570:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784936598.934579:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524077696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936598.934636:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524077696:12345-0@lo:400:kworker.0 Request processed in 58us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936598.934644:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784936598.934664:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784936598.934670:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524077440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936598.934703:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524077440:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936598.934708:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784936598.934759:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524077440:0@lo:400:kworker.0 00000100:00100000:0.0:1784936598.934975:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524077696:0@lo:400:kworker.0 00000100:00080000:2.0:1784936598.935055:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936598.935073:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077568 00000100:00100000:2.0:1784936598.935078:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077568 00000100:00100000:2.0:1784936598.935112:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784936598.935120:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524077568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936598.935377:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524077568:12345-0@lo:400:kworker.0 Request processed in 257us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936598.935385:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1784936598.935477:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c31c1180 x1871641524077568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936598.935490:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524077568:0@lo:400:kworker.0 00010000:00010000:3.0:1784936599.880823:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784936600.098859:0:8370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9bf995c0 20000000:00000080:2.0:1784936600.100701:0:8370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9096d46a1400 uarg=0000000000000000 20000000:01000000:2.0:1784936600.100765:0:8370:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784936600.100773:0:8370:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784936600.100781:0:8370:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784936600.102141:0:8371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1784936600.102416:0:8370:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1784936600.107910:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1784936600.108005:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1784936600.108065:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1784936600.108093:0:8370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784936600.108123:0:8370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108146:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f569e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108155:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108163:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108174:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108183:0:8370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108239:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108336:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 9 pid: 5788 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.108356:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524077824:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936600.108543:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108552:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 18 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.108571:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524077952:0@lo:104: 00000100:00100000:2.0:1784936600.108626:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784936600.108680:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108689:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 18 pid: 5790 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.108698:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524078080:0@lo:104: 00000100:00100000:2.0:1784936600.108722:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784936600.108752:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f569e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936600.108760:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f569e expref: 18 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.108769:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524078208:0@lo:104: 00000100:00100000:2.0:1784936600.108787:0:8370:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a780 going to sleep for 11 seconds 00000100:00100000:1.0:1784936600.109039:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784936600.109061:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936600.109076:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524077952 00000100:00100000:1.0:1784936600.109084:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524077952 00000100:00100000:1.0:1784936600.109134:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078080 00000100:00100000:1.0:1784936600.109137:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078080 00000100:00100000:1.0:1784936600.109149:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078208 00000100:00100000:1.0:1784936600.109152:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078208 00000100:00100000:1.0:1784936600.109167:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784936600.109177:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+5:8370:x1871641524077952:12345-0@lo:104: 00010000:00010000:1.0:1784936600.109194:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109277:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784936600.109284:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+5:8370:x1871641524077952:12345-0@lo:104: Request processed in 108us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.109305:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784936600.109328:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784936600.109334:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:8370:x1871641524078080:12345-0@lo:104: 00010000:00010000:1.0:1784936600.109343:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109376:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784936600.109380:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:8370:x1871641524078080:12345-0@lo:104: Request processed in 47us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.109385:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784936600.109419:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784936600.109447:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8370:x1871641524078208:12345-0@lo:104: 00010000:00010000:1.0:1784936600.109456:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109483:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784936600.109488:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:8370:x1871641524078208:12345-0@lo:104: Request processed in 64us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.109494:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1784936600.109512:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784936600.109519:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109527:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fcc00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936600.109532:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109552:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936600.109560:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936600.109567:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784936600.109601:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109608:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936600.109633:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109640:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fcc00/0x6cf7a864723f57c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f57cb expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109658:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784936600.109662:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109668:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031400 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936600.109670:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109677:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936600.109684:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936600.109695:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784936600.109710:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109717:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936600.109735:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109741:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031400/0x6cf7a864723f56f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5700 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109752:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936600.109755:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109760:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031e00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936600.109763:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109770:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936600.109776:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936600.109782:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784936600.109794:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109800:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936600.109812:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109819:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031e00/0x6cf7a864723f569e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f56a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.109834:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936600.109836:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936600.109838:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936600.109853:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524078336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936600.109897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936600.109936:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524078464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936600.109957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936600.109974:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936600.109979:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524078592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936600.109995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936600.110020:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078336 00000100:00100000:1.0:1784936600.110025:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078336 00010000:00010000:1.0:1784936600.110044:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 19 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936600.110061:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078464 00000100:00100000:1.0:1784936600.110064:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078464 00010000:00010000:1.0:1784936600.110073:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 20 pid: 5790 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936600.110083:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078592 00000100:00100000:1.0:1784936600.110085:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078592 00010000:00010000:1.0:1784936600.110097:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f569e expref: 21 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936600.110122:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784936600.110129:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+21:3308:x1871641524078336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936600.110141:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936600.110147:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 21 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.110156:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 21 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.110174:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936600.110204:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+21:3308:x1871641524078336:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.110210:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784936600.110226:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784936600.110231:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+20:3305:x1871641524078464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936600.110238:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936600.110243:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 20 pid: 5790 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.110251:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 20 pid: 5790 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.110260:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936600.110284:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+20:3305:x1871641524078464:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.110291:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784936600.110303:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784936600.110315:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524078592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936600.110323:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936600.110327:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f569e expref: 19 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.110336:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f569e expref: 19 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.110347:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936600.110370:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524078592:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.110376:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784936600.110423:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524078592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936600.110462:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524078464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936600.110498:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524078336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936600.110708:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f57cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f57c4 expref: 18 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.110723:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524077952:0@lo:104: 00010000:00010000:2.0:1784936600.110733:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165b600/0x6cf7a864723f5700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f56f9 expref: 17 pid: 5790 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.110742:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524078080:0@lo:104: 00010000:00010000:2.0:1784936600.110751:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5800/0x6cf7a864723f56a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f569e expref: 16 pid: 5788 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.110773:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524078208:0@lo:104: 00010000:00010000:3.0:1784936600.111228:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936600.121647:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1871641524077824:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936600.121707:0:8370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936600.123970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936600.124210:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078656 00000100:00100000:1.0:1784936600.124224:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078656 00010000:00010000:1.0:1784936600.124340:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 10 pid: 5788 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936600.124641:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:1.0:1784936600.124655:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2372:x1871641503078656:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936600.124879:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936600.124889:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 10 pid: 5788 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.124907:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 10 pid: 5788 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.124951:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d19600/0x6cf7a864723f5888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bff expref: 10 pid: 5788 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.124975:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.124985:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125005:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125014:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125022:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125030:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125038:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936600.125042:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125052:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125073:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.125096:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936600.125175:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:2372:x1871641503078656:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 522us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936600.125184:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00010000:00010000:0.0:1784936600.125263:0:8370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936600.125273:0:8370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936600.125280:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d18600/0x6cf7a864723f5929 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936600.904715:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784936601.224573:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784936601.224584:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ffa3c000 from 4 10000000:01000000:2.0:1784936601.224589:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784936601.224748:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936601.224764:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936601.224780:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936601.224816:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524078720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936601.224929:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936601.225004:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.226107:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078720 00000100:00100000:0.0:1784936601.226124:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078720 00000100:00100000:0.0:1784936601.226219:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784936601.226230:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524078720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936601.226254:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936601.226279:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5930 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.226316:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.226330:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.226343:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9097021eca00, rc 0) 00000100:00100000:0.0:1784936601.226452:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524078720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.226460:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784936601.226762:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524078720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936601.226786:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936601.226797:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936601.226898:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524078848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936601.226935:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936601.226976:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.227097:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078848 00000100:00100000:0.0:1784936601.227104:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078848 00000100:00100000:0.0:1784936601.227168:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784936601.227177:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524078848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936601.227549:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524078848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 372us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.227557:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784936601.228873:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524078848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.228955:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524078976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.229029:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936601.231676:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784936601.231732:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524078976 00000100:00100000:2.0:1784936601.231744:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524078976 00000100:00100000:2.0:1784936601.232575:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784936601.232590:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524078976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936601.232949:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524078976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 360us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936601.232958:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784936601.233027:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524078976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936601.233611:0:8401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8401:1871641524079104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936601.233669:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936601.233713:0:8401:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a780 going to sleep for 11 seconds 00000100:00100000:1.0:1784936601.233882:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079104 00000100:00100000:1.0:1784936601.233890:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079104 00000100:00100000:1.0:1784936601.233936:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784936601.233945:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:8401:x1871641524079104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936601.234156:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:8401:x1871641524079104:12345-0@lo:502:llog_process_th.0 Request processed in 212us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936601.234165:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784936601.234185:0:8401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8401:1871641524079104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784936601.234217:0:8401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784936601.234229:0:8401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784936601.234242:0:8401:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784936601.234251:0:8401:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096ffa3c000 00000020:00000080:2.0:1784936601.234254:0:8401:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784936601.234344:0:8401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8401:1871641524079232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936601.234381:0:8401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936601.234400:0:8401:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7ece240 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.235792:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079232 00000100:00100000:0.0:1784936601.235808:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079232 00000100:00100000:0.0:1784936601.235887:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784936601.235898:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:8401:x1871641524079232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936601.237143:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:8401:x1871641524079232:12345-0@lo:502:llog_process_th.0 Request processed in 1240us (2754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.237157:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784936601.237272:0:8401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8401:1871641524079232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784936601.237320:0:8401:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936601.237330:0:8401:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936601.237333:0:8401:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784936601.237339:0:8401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784936601.238640:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784936601.238666:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936601.238680:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.238695:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936601.238706:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936601.238710:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096f4d33000 from 4 10000000:01000000:0.0:1784936601.238713:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936601.238758:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.238767:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.238779:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936601.238823:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524079360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936601.238906:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936601.238955:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.238990:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079360 00000100:00100000:0.0:1784936601.238999:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079360 00000100:00100000:0.0:1784936601.240538:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784936601.240551:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524079360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936601.240574:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936601.240595:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f593e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.240628:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f593e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.240640:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f593e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.240651:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9097021ec400, rc 0) 00000100:00100000:0.0:1784936601.240743:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524079360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.240750:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784936601.240906:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524079360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936601.240931:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936601.240952:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936601.241469:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524079488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.241513:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936601.241551:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936601.244006:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079488 00000100:00100000:1.0:1784936601.244026:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079488 00000100:00100000:1.0:1784936601.244094:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784936601.244106:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524079488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936601.245178:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524079488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1069us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936601.245190:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784936601.246595:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524079488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.246671:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524079616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.246744:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936601.246786:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936601.246809:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079616 00000100:00100000:3.0:1784936601.246816:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079616 00000100:00100000:3.0:1784936601.246873:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784936601.246883:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524079616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.247204:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524079616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 320us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936601.247211:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784936601.247284:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524079616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936601.251590:0:8403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8403:1871641524079744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936601.251705:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936601.251779:0:8403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7ece240 going to sleep for 11 seconds 00000100:00100000:1.0:1784936601.251926:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079744 00000100:00100000:1.0:1784936601.251937:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079744 00000100:00100000:1.0:1784936601.252016:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784936601.252029:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:8403:x1871641524079744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936601.252565:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:8403:x1871641524079744:12345-0@lo:502:llog_process_th.0 Request processed in 536us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936601.252583:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784936601.252618:0:8403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8403:1871641524079744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936601.252663:0:8403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936601.252676:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936601.252679:0:8403:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784936601.252699:0:8403:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096f4d33000 00000020:00000080:3.0:1784936601.252702:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784936601.252803:0:8403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8403:1871641524079872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936601.252868:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936601.252895:0:8403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.255523:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524079872 00000100:00100000:0.0:1784936601.255543:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524079872 00000100:00100000:0.0:1784936601.255620:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784936601.255634:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:8403:x1871641524079872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936601.259163:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:8403:x1871641524079872:12345-0@lo:502:llog_process_th.0 Request processed in 3515us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936601.259184:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784936601.260212:0:8403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8403:1871641524079872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784936601.260289:0:8403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936601.260299:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936601.260302:0:8403:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784936601.260308:0:8403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784936601.264132:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784936601.264186:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784936601.264203:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936601.264219:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936601.264234:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784936601.264238:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096d473e000 from 4 10000000:01000000:1.0:1784936601.264241:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784936601.264301:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936601.264311:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936601.264326:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936601.264362:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524080000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784936601.264511:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936601.264575:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c82cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.264655:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080000 00000100:00100000:0.0:1784936601.264666:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080000 00000100:00100000:0.0:1784936601.264720:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784936601.264730:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524080000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936601.264748:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936601.264764:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f594c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.264794:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f594c expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.264806:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f594c expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.264816:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9097021edc00, rc 0) 00000100:00100000:0.0:1784936601.264879:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524080000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.264886:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784936601.265137:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524080000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936601.265167:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936601.265178:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936601.265242:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524080128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936601.265273:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936601.265301:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c82cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.265345:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080128 00000100:00100000:0.0:1784936601.265349:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080128 00000100:00100000:0.0:1784936601.265382:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784936601.265390:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524080128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936601.265731:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524080128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.265748:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784936601.265858:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524080128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936601.265892:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524080256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936601.265932:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936601.265962:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c82cc600 going to sleep for 11 seconds 00000100:00100000:1.0:1784936601.265974:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080256 00000100:00100000:1.0:1784936601.265979:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080256 00000100:00100000:1.0:1784936601.266000:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784936601.266116:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524080256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936601.266339:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524080256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936601.266346:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784936601.270207:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524080256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936601.270633:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8405:1871641524080384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936601.270728:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936601.270778:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080384 00000100:00100000:0.0:1784936601.270786:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080384 00000100:00100000:3.0:1784936601.270790:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936601.270856:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1784936601.270868:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:8405:x1871641524080384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936601.271223:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:8405:x1871641524080384:12345-0@lo:502:llog_process_th.0 Request processed in 355us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936601.271233:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784936601.271258:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8405:1871641524080384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936601.271289:0:8405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936601.271303:0:8405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936601.271306:0:8405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784936601.271328:0:8405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096d473e000 00000020:00000080:3.0:1784936601.271331:0:8405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784936601.271424:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8405:1871641524080512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936601.271490:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936601.271514:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080512 00000100:00100000:3.0:1784936601.271518:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080512 00000100:00100000:3.0:1784936601.271547:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784936601.271554:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:8405:x1871641524080512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936601.271681:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:8405:x1871641524080512:12345-0@lo:502:llog_process_th.0 Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936601.271687:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784936601.271720:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3780 going to sleep for 11 seconds 00000100:00100000:3.0:1784936601.271731:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:8405:1871641524080512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936601.271749:0:8405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936601.271754:0:8405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936601.271755:0:8405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784936601.271760:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784936601.272081:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784936601.272109:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936601.272122:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936601.272137:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936601.929895:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936602.173256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936602.173374:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078784 00000100:00100000:3.0:1784936602.173389:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078784 00000100:00100000:3.0:1784936602.174136:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 188 00000100:00100000:3.0:1784936602.174152:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:5591:x1871641503078784:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936602.174176:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936602.174200:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c3e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936602.174249:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936602.174265:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936602.174277:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4c00, rc 0) 00000100:00100000:3.0:1784936602.174353:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503078784:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 204us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936602.174360:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 188 00000100:00100000:3.0:1784936602.184351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936602.184491:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503078912 00000100:00100000:0.0:1784936602.184516:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503078912 00000100:00100000:0.0:1784936602.184590:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 189 00000100:00100000:0.0:1784936602.184603:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503078912:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936602.185409:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503078912:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 803us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936602.185420:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 189 00000100:00100000:2.0:1784936602.190305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936602.193576:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079040 00000100:00100000:1.0:1784936602.193595:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079040 00000100:00100000:1.0:1784936602.193669:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 190 00000100:00100000:1.0:1784936602.193682:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503079040:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936602.193976:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:5591:x1871641503079040:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 296us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936602.193990:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 190 00000100:00100000:0.0:1784936602.204002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936602.206962:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079168 00000100:00100000:1.0:1784936602.206989:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079168 00000100:00100000:1.0:1784936602.207093:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:1.0:1784936602.207105:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:6146:x1871641503079168:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784936602.207479:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:6146:x1871641503079168:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 374us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936602.207488:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:3.0:1784936602.221509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936602.224866:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079296 00000100:00100000:2.0:1784936602.224886:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079296 00000100:00100000:3.0:1784936602.226252:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 192 00000100:00100000:3.0:1784936602.226280:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:6146:x1871641503079296:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784936602.226760:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:6146:x1871641503079296:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 490us (5262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936602.226770:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 192 00000100:00100000:1.0:1784936602.508155:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524080640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936602.508265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936602.508379:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080640 00000100:00100000:1.0:1784936602.508388:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080640 00000100:00100000:1.0:1784936602.508498:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784936602.508509:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524080640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936602.508557:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936602.508613:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524080640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936602.508623:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1784936602.508651:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784936602.508692:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c7cae680 x1871641524080640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936602.508726:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524080640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936602.953741:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936603.581002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936603.581081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936603.581127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936603.581157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936603.581343:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079680 00000100:00100000:2.0:1784936603.581356:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079680 00000100:00100000:2.0:1784936603.581559:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079808 00000100:00100000:2.0:1784936603.581563:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079808 00000100:00100000:3.0:1784936603.581632:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079424 00000100:00100000:3.0:1784936603.581637:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079424 00000100:00100000:3.0:1784936603.581678:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 193 00000100:00100000:3.0:1784936603.581689:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503079424:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936603.581796:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503079424:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 108us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936603.581814:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 193 00000100:00100000:3.0:1784936603.581880:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:3.0:1784936603.581888:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503079680:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936603.581921:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503079680:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 33us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936603.581927:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00080000:0.0:1784936603.582580:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936603.582587:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936603.582822:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079552 00000100:00100000:1.0:1784936603.582832:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079552 00000100:00100000:2.0:1784936603.582887:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1784936603.582899:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503079808:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936603.582906:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:1.0:1784936603.582918:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503079552:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936603.582956:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503079808:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 61us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936603.582966:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:1.0:1784936603.582969:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503079552:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 50us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936603.582980:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00080000:0.0:1784936603.583303:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784936603.976609:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936604.047376:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524081152:0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.047516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936604.047613:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784936604.047621:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524080768:0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.047657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936604.047685:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524081280:0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.047712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936604.047764:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524080896:0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.047804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936604.047829:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524081408:0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.047852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936604.047880:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936604.047887:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524081024:0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.047910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936604.047944:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081152 00000100:00100000:0.0:1784936604.047958:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081152 00000100:00100000:3.0:1784936604.047961:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080768 00000100:00100000:3.0:1784936604.047968:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080768 00000100:00100000:3.0:1784936604.048026:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784936604.048029:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081408 00000100:00100000:0.0:1784936604.048035:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081408 00000100:00100000:3.0:1784936604.048040:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524080768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936604.048066:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784936604.048078:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524081152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936604.048111:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524080768:12345-0@lo:400:kworker.0 Request processed in 74us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936604.048121:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784936604.048133:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524081152:12345-0@lo:400:kworker.0 Request processed in 58us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936604.048142:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784936604.048170:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784936604.048177:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524081408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936604.048212:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524081408:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936604.048219:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784936604.048280:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524081536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936604.048521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784936604.048561:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936604.048566:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936604.048579:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081536 00000100:00100000:0.0:1784936604.048584:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081536 00000100:00100000:0.0:1784936604.048613:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784936604.048620:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524081536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936604.048664:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936604.048708:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524081536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936604.048715:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1784936604.048758:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9095c1eae680 x1871641524081536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936604.048779:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524081536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936604.048853:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081280 00000100:00100000:0.0:1784936604.048858:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081280 00000100:00100000:0.0:1784936604.048896:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524080896 00000100:00100000:0.0:1784936604.048899:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524080896 00000100:00100000:0.0:1784936604.048910:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081024 00000100:00100000:0.0:1784936604.048913:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081024 00000100:00100000:0.0:1784936604.048929:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784936604.048934:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524081280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936604.048970:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524081280:12345-0@lo:400:kworker.0 Request processed in 36us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936604.048976:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784936604.049065:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784936604.049072:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524080896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936604.049104:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524080896:12345-0@lo:400:kworker.0 Request processed in 35us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936604.049110:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784936604.049120:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784936604.049125:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524081024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936604.049152:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524081024:12345-0@lo:400:kworker.0 Request processed in 26us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936604.049165:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1784936604.049190:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936604.049238:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524080768:0@lo:400:kworker.0 00000100:00100000:0.0:1784936604.049253:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524081280:0@lo:400:kworker.0 00010000:00080000:0.0:1784936604.049266:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8ed80 x1871641524081152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936604.049275:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524081152:0@lo:400:kworker.0 00000100:00100000:2.0:1784936604.051881:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524081024:0@lo:400:kworker.0 00000100:00100000:2.0:1784936604.051906:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524080896:0@lo:400:kworker.0 00010000:00080000:2.0:1784936604.051924:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8dc00 x1871641524081408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936604.051945:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524081408:0@lo:400:kworker.0 00010000:00010000:1.0:1784936605.001794:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936606.024577:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784936606.806907:0:8670:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1784936607.048590:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936607.628947:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524081664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936607.629018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936607.629099:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081664 00000100:00100000:1.0:1784936607.629108:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081664 00000100:00100000:1.0:1784936607.629183:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784936607.629193:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524081664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936607.629237:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936607.629290:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524081664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936607.629298:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1784936607.629322:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784936607.629358:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c7cae680 x1871641524081664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936607.629378:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524081664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784936608.073667:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936608.697352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936608.697413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936608.697653:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503079936 00000100:00100000:2.0:1784936608.697667:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503079936 00000100:00100000:2.0:1784936608.697754:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 195 00000100:00100000:2.0:1784936608.697767:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503079936:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936608.697863:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503079936:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 97us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936608.697871:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 195 00000100:00100000:1.0:1784936608.698778:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080064 00000100:00100000:1.0:1784936608.698787:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080064 00000100:00100000:1.0:1784936608.698845:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:1.0:1784936608.698853:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503080064:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936608.698920:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503080064:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 67us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936608.698928:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00080000:1.0:1784936608.698950:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936608.708837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936608.709016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936608.709778:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080192 00000100:00100000:0.0:1784936608.709792:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080192 00000100:00100000:0.0:1784936608.709916:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080320 00000100:00100000:0.0:1784936608.709920:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080320 00000100:00100000:2.0:1784936608.709964:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:2.0:1784936608.709979:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2370:x1871641503080192:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:2.0:1784936608.710051:0:6595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5896 00000100:00080000:2.0:1784936608.710067:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9096ef1ef000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784936608.710125:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784936608.710578:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+2:2370:x1871641503080192:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 600us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936608.710587:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00080000:1.0:1784936608.711239:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936608.711245:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784936608.711276:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936608.711721:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:2.0:1784936608.711740:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2370:x1871641503080320:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:2.0:1784936608.711771:0:6595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f589d 00000100:00080000:2.0:1784936608.711781:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9096ef1ea800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784936608.711816:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784936608.712259:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+2:2370:x1871641503080320:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 524us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936608.712268:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00010000:00010000:1.0:1784936608.712332:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936609.100711:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936609.163345:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936609.163372:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524081792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936609.163479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936609.166470:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524082304:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.166543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936609.166582:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784936609.166588:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524082176:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.166612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936609.166681:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524081920:0@lo:400:kworker.0 00000100:00100000:2.0:1784936609.166731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936609.166764:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524082432:0@lo:400:kworker.0 00000100:00100000:2.0:1784936609.166796:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081920 00000100:00100000:2.0:1784936609.166803:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081920 00000100:00100000:2.0:1784936609.166849:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784936609.166857:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524081920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936609.166909:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524081920:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936609.166916:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784936609.167039:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524082048:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.167173:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524081792 00000100:00100000:1.0:1784936609.167178:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524081792 00000100:00100000:1.0:1784936609.167227:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784936609.167235:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524081792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784936609.167264:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936609.167304:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524081792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936609.167310:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784936609.167332:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082304 00000100:00100000:1.0:1784936609.167336:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082304 00000100:00100000:1.0:1784936609.167365:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784936609.167373:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936609.167374:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524082304:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784936609.167388:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936609.167458:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524082304:12345-0@lo:400:kworker.0 Request processed in 86us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936609.167465:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784936609.167487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784936609.167829:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede90000 x1871641524082304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936609.167842:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524082304:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.168029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936609.168047:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082176 00000100:00100000:3.0:1784936609.168051:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082176 00000100:00100000:2.0:1784936609.168069:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082048 00000100:00100000:2.0:1784936609.168076:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082048 00000100:00100000:3.0:1784936609.168098:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784936609.168108:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524082176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936609.168113:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784936609.168123:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524082048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936609.168172:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524082048:12345-0@lo:400:kworker.0 Request processed in 50us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936609.168180:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524082176:12345-0@lo:400:kworker.0 Request processed in 72us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936609.168182:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784936609.168192:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1784936609.168217:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936609.168235:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524082176:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.168393:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524081920:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.168415:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082432 00000100:00100000:1.0:1784936609.168418:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082432 00000100:00100000:1.0:1784936609.168645:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784936609.168652:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524082432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.168806:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524082432:12345-0@lo:400:kworker.0 Request processed in 154us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936609.168813:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784936609.168840:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524082048:0@lo:400:kworker.0 00000100:00100000:1.0:1784936609.168859:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524082432:0@lo:400:kworker.0 00010000:00080000:1.0:1784936609.168884:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8ea00 x1871641524081792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936609.168901:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524081792:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784936609.168962:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936610.130847:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936611.144920:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784936611.724490:0:8915:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing yml_node 00010000:00010000:1.0:1784936612.170384:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784936612.282207:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:1.0:1784936612.282218:0:6623:0:(genops.c:906:class_export_put()) final put ffff9096ef1e9000/486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:2.0:1784936612.282287:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1e9000/486efceb-7a20-41d5-8389-4305380725bf for lustre-OST0000 00000020:00000080:2.0:1784936612.282342:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1ef000 for lustre-OST0000 00000001:00100000:2.0:1784936612.285866:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:2.0:1784936612.285876:0:7508:0:(genops.c:906:class_export_put()) final put ffff9096ef1ea000/486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:0.0:1784936612.285995:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1ea000/486efceb-7a20-41d5-8389-4305380725bf for lustre-OST0001 00000020:00000080:0.0:1784936612.286182:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1ea800 for lustre-OST0001 00000100:00100000:3.0:1784936612.744724:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936612.744754:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524082560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936612.744840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936612.745078:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082560 00000100:00100000:1.0:1784936612.745087:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082560 00000100:00100000:1.0:1784936612.745167:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784936612.745175:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524082560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936612.745211:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784936612.745237:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936612.745265:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524082560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936612.745273:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784936612.745308:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede92d80 x1871641524082560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936612.745329:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524082560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936613.192728:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936613.817414:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936613.817631:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080448 00000100:00100000:0.0:1784936613.817647:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080448 00000100:00100000:0.0:1784936613.817731:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:0.0:1784936613.817750:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503080448:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936613.817875:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503080448:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 131us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936613.817883:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:1.0:1784936613.819421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936613.819811:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080576 00000100:00100000:2.0:1784936613.819822:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080576 00000100:00100000:2.0:1784936613.819915:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:2.0:1784936613.819926:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503080576:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936613.819998:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503080576:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 75us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936613.820006:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00080000:0.0:1784936613.820340:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936614.216824:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936614.280703:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784936614.280730:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524082688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936614.280802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936614.280881:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082688 00000100:00100000:3.0:1784936614.280897:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082688 00000100:00100000:3.0:1784936614.281027:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784936614.281043:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524082688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936614.281074:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524082944:0@lo:400:kworker.0 00002000:00000024:3.0:1784936614.281093:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936614.281122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936614.281167:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784936614.281180:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524083072:0@lo:400:kworker.0 00000100:00100000:3.0:1784936614.281189:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524082688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936614.281197:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784936614.281227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936614.281266:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082944 00000100:00100000:3.0:1784936614.281272:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082944 00000100:00100000:3.0:1784936614.281414:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083072 00000100:00100000:3.0:1784936614.281420:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083072 00000100:00100000:0.0:1784936614.281477:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524083200:0@lo:400:kworker.0 00000100:00100000:0.0:1784936614.281513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936614.281537:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784936614.281543:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524082816:0@lo:400:kworker.0 00000100:00100000:0.0:1784936614.281568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936614.281590:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524083328:0@lo:400:kworker.0 00000100:00100000:0.0:1784936614.281627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936614.284275:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083200 00000100:00100000:0.0:1784936614.284291:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083200 00000100:00100000:0.0:1784936614.284367:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784936614.284378:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524083200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936614.284472:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524083200:12345-0@lo:400:kworker.0 Request processed in 97us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936614.284479:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784936614.284505:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524082816 00000100:00100000:0.0:1784936614.284509:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524082816 00000100:00100000:0.0:1784936614.284540:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784936614.284548:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524082816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936614.284581:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524082816:12345-0@lo:400:kworker.0 Request processed in 34us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936614.284587:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784936614.284888:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524082816:0@lo:400:kworker.0 00010000:00080000:0.0:1784936614.284905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede56a00 x1871641524083200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936614.284917:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524083200:0@lo:400:kworker.0 00000100:00080000:0.0:1784936614.285064:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936614.285069:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784936614.285072:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784936614.285103:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede91c00 x1871641524082688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936614.285120:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524082688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936614.285207:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083328 00000100:00100000:2.0:1784936614.285222:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083328 00000100:00100000:1.0:1784936614.285234:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784936614.285252:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524082944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936614.285292:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784936614.285302:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524083072:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784936614.285372:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936614.285373:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524082944:12345-0@lo:400:kworker.0 Request processed in 122us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936614.285383:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524083072:12345-0@lo:400:kworker.0 Request processed in 77us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936614.285391:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784936614.285401:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784936614.285471:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784936614.285472:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524083072:0@lo:400:kworker.0 00000100:00100000:1.0:1784936614.285487:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524083328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936614.285499:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524082944:0@lo:400:kworker.0 00000100:00100000:1.0:1784936614.285552:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524083328:12345-0@lo:400:kworker.0 Request processed in 70us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936614.285560:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784936614.285576:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524083328:0@lo:400:kworker.0 00000001:02000400:1.0:1784936614.960753:0:9108:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.207 00010000:00010000:1.0:1784936615.243024:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936616.264962:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784936617.187308:0:9206:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.207 00010000:00010000:1.0:1784936617.292060:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936617.871341:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524083456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936617.871466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936617.872108:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083456 00000100:00100000:3.0:1784936617.872119:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083456 00000100:00100000:3.0:1784936617.872195:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784936617.872206:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524083456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936617.872257:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936617.872329:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524083456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936617.872337:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1784936617.872364:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784936617.872409:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede90380 x1871641524083456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936617.872457:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524083456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936618.312666:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936618.934942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936618.935022:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080832 00000100:00100000:2.0:1784936618.935032:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080832 00000100:00100000:2.0:1784936618.935108:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:2.0:1784936618.935118:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503080832:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936618.935198:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503080832:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936618.935206:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00080000:3.0:1784936618.935451:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936618.935628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936618.935724:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080704 00000100:00100000:0.0:1784936618.935729:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080704 00000100:00100000:0.0:1784936618.935769:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 199 00000100:00100000:0.0:1784936618.935776:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503080704:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936618.935819:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503080704:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936618.935826:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 199 00010000:00010000:1.0:1784936619.337634:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936619.401171:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936619.401192:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524083584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936619.401253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936619.401297:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083584 00000100:00100000:3.0:1784936619.401305:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083584 00000100:00100000:3.0:1784936619.401376:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784936619.401386:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524083584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936619.401421:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936619.401423:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524083840:0@lo:400:kworker.0 00000100:00100000:3.0:1784936619.401512:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524083584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936619.401519:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1784936619.401538:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784936619.402069:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524083712:0@lo:400:kworker.0 00000100:00100000:2.0:1784936619.402108:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936619.402135:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524084224:0@lo:400:kworker.0 00000100:00100000:2.0:1784936619.402155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936619.402206:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084224 00000100:00100000:3.0:1784936619.402212:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084224 00000100:00100000:3.0:1784936619.402259:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784936619.402266:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524084224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936619.402305:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524084224:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936619.402312:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1784936619.402405:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936619.402452:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524084224:0@lo:400:kworker.0 00000100:00100000:1.0:1784936619.402761:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524084096:0@lo:400:kworker.0 00000100:00100000:1.0:1784936619.402794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936619.402823:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784936619.402828:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524083968:0@lo:400:kworker.0 00000100:00100000:1.0:1784936619.402846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936619.402868:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083968 00000100:00100000:1.0:1784936619.402872:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083968 00000100:00100000:1.0:1784936619.402903:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784936619.402908:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524083968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936619.402939:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524083968:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936619.402945:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784936619.402967:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524083968:0@lo:400:kworker.0 00000100:00080000:1.0:1784936619.402982:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784936619.403000:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4ef9c00 x1871641524083584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936619.403016:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524083584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936619.403036:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083712 00000100:00100000:1.0:1784936619.403039:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083712 00000100:00100000:1.0:1784936619.403059:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1784936619.403064:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524083712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936619.403090:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524083712:12345-0@lo:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936619.403095:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784936619.405005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936619.405082:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524083840 00000100:00100000:0.0:1784936619.405090:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524083840 00000100:00100000:0.0:1784936619.405156:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784936619.405165:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524083840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936619.405221:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524083840:12345-0@lo:400:kworker.0 Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936619.405228:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784936619.405455:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524083712:0@lo:400:kworker.0 00000100:00100000:3.0:1784936619.405643:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084096 00000100:00100000:3.0:1784936619.405648:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084096 00000100:00100000:3.0:1784936619.405691:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784936619.405698:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524084096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936619.405746:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524084096:12345-0@lo:400:kworker.0 Request processed in 49us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936619.405754:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784936619.409140:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936619.412022:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524083840:0@lo:400:kworker.0 00010000:00080000:1.0:1784936619.412072:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efa680 x1871641524084096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936619.412086:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524084096:0@lo:400:kworker.0 00000001:02000400:0.0:1784936619.513280:0:9304:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.207 00010000:00010000:1.0:1784936620.360919:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784936621.180718:0:9352:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 24 19:43:39 EDT 2026 00010000:00010000:1.0:1784936621.394305:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936622.409552:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936622.987606:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524084352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936622.987684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936622.987859:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084352 00000100:00100000:1.0:1784936622.987866:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084352 00000100:00100000:1.0:1784936622.987917:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784936622.987925:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524084352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936622.987959:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936622.988001:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524084352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936622.988008:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1784936622.988071:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efb100 x1871641524084352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936622.988089:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524084352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784936622.990958:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784936623.434477:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936624.055978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936624.056032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936624.056094:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503080960 00000100:00100000:0.0:1784936624.056105:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503080960 00000100:00100000:0.0:1784936624.056163:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 201 00000100:00100000:0.0:1784936624.056173:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503080960:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936624.056248:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503080960:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936624.056255:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 201 00000100:00100000:3.0:1784936624.056329:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081088 00000100:00100000:3.0:1784936624.056334:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081088 00000100:00100000:3.0:1784936624.056392:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1784936624.056400:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503081088:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936624.056485:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503081088:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 86us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936624.056502:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00080000:0.0:1784936624.056916:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936624.458609:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936624.520736:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524084608:0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.520757:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524084864:0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.520808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936624.520862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936624.520867:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936624.520873:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524084736:0@lo:400:kworker.0 00000100:00100000:3.0:1784936624.520885:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524085120:0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.520893:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936624.520903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936624.520920:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084864 00000100:00100000:3.0:1784936624.520922:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784936624.520927:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524084480:0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.520945:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084864 00000100:00100000:3.0:1784936624.520955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936624.520972:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524084992:0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.520996:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085120 00000100:00100000:2.0:1784936624.521000:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085120 00000100:00100000:3.0:1784936624.521004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936624.521022:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784936624.521028:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084608 00000100:00100000:2.0:1784936624.521030:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524084864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936624.521031:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084608 00000100:00100000:3.0:1784936624.521053:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084736 00000100:00100000:3.0:1784936624.521055:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084736 00000100:00100000:3.0:1784936624.521068:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084992 00000100:00100000:3.0:1784936624.521071:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084992 00000100:00100000:3.0:1784936624.521084:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784936624.521084:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524084864:12345-0@lo:400:kworker.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936624.521089:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524084608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.521092:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784936624.521108:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784936624.521114:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524085120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936624.521121:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524084608:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936624.521126:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784936624.521137:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784936624.521137:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524085120:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936624.521142:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524084736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.521143:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1784936624.521160:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784936624.521165:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784936624.521167:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936624.521195:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524084736:0@lo:400:kworker.0 00010000:00080000:2.0:1784936624.521229:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede54700 x1871641524084864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936624.521232:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524084736:12345-0@lo:400:kworker.0 Request processed in 23us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936624.521240:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524084864:0@lo:400:kworker.0 00000100:00100000:3.0:1784936624.521246:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784936624.521258:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784936624.521264:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524084992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.521312:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524084992:0@lo:400:kworker.0 00010000:00080000:2.0:1784936624.521322:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede54380 x1871641524085120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936624.521426:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524084992:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936624.521459:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784936624.521592:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524085120:0@lo:400:kworker.0 00000100:00100000:2.0:1784936624.521609:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524084608:0@lo:400:kworker.0 00000100:00100000:1.0:1784936624.521837:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524084480 00000100:00100000:1.0:1784936624.521843:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524084480 00000100:00100000:1.0:1784936624.521878:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784936624.521884:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524084480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936624.521937:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524084480:12345-0@lo:400:kworker.0 Request processed in 53us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936624.521943:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784936624.522081:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936624.522090:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524085248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936624.522115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936624.522180:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085248 00000100:00100000:0.0:1784936624.522184:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085248 00000100:00100000:0.0:1784936624.522251:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784936624.522259:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524085248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936624.522266:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524084480:0@lo:400:kworker.0 00002000:00000024:0.0:1784936624.522286:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1784936624.522399:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4ef9f80 x1871641524085248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936624.522399:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524085248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936624.522417:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784936624.522425:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524085248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784936625.481879:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936626.511171:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936627.529640:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936628.104871:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524085376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936628.104944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936628.105020:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085376 00000100:00100000:2.0:1784936628.105028:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085376 00000100:00100000:2.0:1784936628.105089:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784936628.105098:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524085376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784936628.105133:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936628.105186:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524085376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936628.105194:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1784936628.105313:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784936628.106618:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede54380 x1871641524085376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936628.106643:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524085376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784936628.556036:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936629.174869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936629.175235:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081216 00000100:00100000:1.0:1784936629.175250:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081216 00000100:00100000:1.0:1784936629.175331:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 203 00000100:00100000:1.0:1784936629.175342:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503081216:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936629.175458:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503081216:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 117us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936629.175467:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 203 00000100:00100000:0.0:1784936629.176051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936629.176109:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081344 00000100:00100000:3.0:1784936629.176122:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081344 00000100:00100000:3.0:1784936629.176340:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1784936629.176353:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503081344:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936629.176460:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503081344:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 110us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936629.176469:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00080000:0.0:1784936629.182263:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936629.578573:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936629.644776:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936629.644814:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524085504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936629.644933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936629.645031:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085504 00000100:00100000:3.0:1784936629.645061:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085504 00000100:00100000:3.0:1784936629.645145:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784936629.645156:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524085504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936629.645210:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936629.645268:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524085504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936629.645276:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1784936629.645325:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784936629.645375:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede8f480 x1871641524085504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936629.645398:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524085504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936629.646407:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524085632:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.646543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936629.646583:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524086144:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.646607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936629.646634:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936629.646639:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524086016:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.646662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936629.646792:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085632 00000100:00100000:2.0:1784936629.646799:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085632 00000100:00100000:2.0:1784936629.646857:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784936629.646867:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524085632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936629.646921:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524085632:12345-0@lo:400:kworker.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936629.646928:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784936629.646996:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086016 00000100:00100000:3.0:1784936629.647000:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086016 00000100:00100000:3.0:1784936629.647044:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784936629.647051:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524086016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.647088:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524086016:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936629.647095:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1784936629.647128:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4ef9f80 x1871641524086016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936629.647156:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524086016:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.647169:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524085632:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.647220:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524085760:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.647268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936629.647539:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086144 00000100:00100000:0.0:1784936629.647545:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086144 00000100:00100000:0.0:1784936629.647600:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085760 00000100:00100000:0.0:1784936629.647604:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085760 00000100:00100000:0.0:1784936629.647626:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784936629.647634:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524086144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784936629.647770:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936629.648000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936629.648014:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524085888:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.648048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936629.648076:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524085888 00000100:00100000:3.0:1784936629.648080:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524085888 00000100:00100000:3.0:1784936629.648119:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784936629.648126:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524085760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.648166:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524085760:12345-0@lo:400:kworker.0 Request processed in 40us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936629.648172:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784936629.648188:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784936629.648194:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524085888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.648222:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524085888:12345-0@lo:400:kworker.0 Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936629.648228:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784936629.648265:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524085888:0@lo:400:kworker.0 00000100:00100000:3.0:1784936629.648275:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524085760:0@lo:400:kworker.0 00000100:00100000:0.0:1784936629.648369:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524086144:12345-0@lo:400:kworker.0 Request processed in 734us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936629.648375:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1784936629.648513:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936629.648785:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524086144:0@lo:400:kworker.0 00010000:00010000:3.0:1784936630.601235:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936631.624963:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936632.649583:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936633.228295:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936633.228319:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524086272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936633.228385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936633.228588:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086272 00000100:00100000:1.0:1784936633.228599:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086272 00000100:00100000:1.0:1784936633.228675:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784936633.228686:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524086272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936633.228723:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936633.228770:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524086272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936633.228778:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1784936633.229517:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784936633.229721:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede54700 x1871641524086272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936633.229742:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524086272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936633.673996:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936634.294006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936634.294134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.294962:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081600 00000100:00100000:0.0:1784936634.294973:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081600 00000100:00100000:0.0:1784936634.295039:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1784936634.295049:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503081600:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936634.295125:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503081600:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 77us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.295132:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00080000:2.0:1784936634.295265:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936634.298702:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081472 00000100:00100000:1.0:1784936634.298732:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081472 00000100:00100000:0.0:1784936634.299034:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 205 00000100:00100000:0.0:1784936634.299045:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503081472:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936634.299137:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2371:x1871641503081472:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 94us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.299145:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 205 00000001:02000400:2.0:1784936634.470996:0:9981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:43:53 (1784936633) === 00010000:00010000:1.0:1784936634.696654:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936634.760699:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524086400:0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.760788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936634.760930:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086400 00000100:00100000:0.0:1784936634.760939:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086400 00000100:00100000:0.0:1784936634.760995:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784936634.761005:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524086400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.761078:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524086400:12345-0@lo:400:kworker.0 Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.761086:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784936634.761200:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524086400:0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.761220:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524086912:0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.761248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936634.761294:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936634.761301:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524086784:0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.761329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936634.761369:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086784 00000100:00100000:2.0:1784936634.761374:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086784 00000100:00100000:2.0:1784936634.761407:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784936634.761413:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524086784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.761648:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524086784:12345-0@lo:400:kworker.0 Request processed in 233us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936634.761655:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1784936634.761689:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4ef9c00 x1871641524086784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936634.761702:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524086784:0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.761773:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086912 00000100:00100000:0.0:1784936634.761778:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086912 00000100:00100000:0.0:1784936634.761825:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784936634.761850:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524086528:0@lo:400:kworker.0 00000100:00100000:1.0:1784936634.761883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936634.761908:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524087040:0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.761912:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524086912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936634.761928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936634.761947:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936634.761948:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524086912:12345-0@lo:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936634.761953:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524086656:0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.761954:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784936634.761964:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086528 00000100:00100000:0.0:1784936634.761967:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086528 00000100:00100000:1.0:1784936634.761974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784936634.762016:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936634.762036:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524086912:0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.762067:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087040 00000100:00100000:2.0:1784936634.762071:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087040 00000100:00100000:2.0:1784936634.762101:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784936634.762107:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524087040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936634.762142:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524087040:12345-0@lo:400:kworker.0 Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936634.762154:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784936634.763381:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524086656 00000100:00100000:0.0:1784936634.763394:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524086656 00000100:00100000:0.0:1784936634.763461:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784936634.763471:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524086528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.763533:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524086528:12345-0@lo:400:kworker.0 Request processed in 64us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.763540:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784936634.763554:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784936634.763560:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524086656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.763587:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524086656:12345-0@lo:400:kworker.0 Request processed in 28us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.763591:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784936634.763666:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524086656:0@lo:400:kworker.0 00000100:00100000:0.0:1784936634.763678:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524086528:0@lo:400:kworker.0 00010000:00080000:0.0:1784936634.763714:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efb100 x1871641524087040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936634.763723:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524087040:0@lo:400:kworker.0 00000100:00080000:0.0:1784936634.763765:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784936634.763769:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936634.763815:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936634.763823:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524087168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936634.763866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936634.763902:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087168 00000100:00100000:0.0:1784936634.763905:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087168 00000100:00100000:0.0:1784936634.763930:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784936634.763936:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524087168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936634.763966:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936634.764001:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524087168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.764008:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1784936634.764035:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efb100 x1871641524087168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936634.764051:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524087168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936634.798758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.799288:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081728 00000100:00100000:0.0:1784936634.799300:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081728 00000100:00100000:0.0:1784936634.799539:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 207 00000100:00100000:0.0:1784936634.799551:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:8140:x1871641503081728:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784936634.799570:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936634.799591:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9097021ed000/0x6cf7a864723f5961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c45 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.800049:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9097021ed000/0x6cf7a864723f5961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c45 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.800064:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9097021ed000/0x6cf7a864723f5961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c45 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.800076:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9097021ed000, rc 0) 00000100:00100000:0.0:1784936634.800138:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8140:x1871641503081728:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 589us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.800145:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 207 00000100:00100000:3.0:1784936634.814554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.814743:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081856 00000100:00100000:0.0:1784936634.814755:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081856 00000100:00100000:0.0:1784936634.814820:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 208 00000100:00100000:0.0:1784936634.814830:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8140:x1871641503081856:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784936634.815176:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8140:x1871641503081856:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 346us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.815184:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 208 00000100:00100000:2.0:1784936634.825157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.829128:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503081984 00000100:00100000:0.0:1784936634.830361:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503081984 00000100:00100000:0.0:1784936634.830594:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 209 00000100:00100000:0.0:1784936634.830607:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8140:x1871641503081984:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784936634.831661:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8140:x1871641503081984:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 1051us (6519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.831673:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 209 00000100:00100000:3.0:1784936634.837248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.837366:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082112 00000100:00100000:0.0:1784936634.837394:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082112 00000100:00100000:0.0:1784936634.837478:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:0.0:1784936634.837489:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8144:x1871641503082112:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784936634.839160:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8144:x1871641503082112:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 1664us (3184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.839175:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:3.0:1784936634.864611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.864690:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082240 00000100:00100000:0.0:1784936634.864699:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082240 00000100:00100000:0.0:1784936634.864763:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 211 00000100:00100000:0.0:1784936634.864773:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8144:x1871641503082240:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784936634.865413:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8144:x1871641503082240:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 638us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.865422:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 211 00000100:00100000:2.0:1784936634.871672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.872461:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082368 00000100:00100000:0.0:1784936634.872472:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082368 00000100:00100000:0.0:1784936634.872540:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 212 00000100:00100000:0.0:1784936634.872550:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:8140:x1871641503082368:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784936634.872568:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936634.874068:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9097021ec200/0x6cf7a864723f5968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c6f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.874117:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9097021ec200/0x6cf7a864723f5968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c6f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.874131:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9097021ec200/0x6cf7a864723f5968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c6f expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.874161:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9097021ec200, rc 0) 00000100:00100000:0.0:1784936634.874242:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:8140:x1871641503082368:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 1692us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.874251:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 212 00000100:00100000:3.0:1784936634.882423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.882562:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082496 00000100:00100000:0.0:1784936634.882573:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082496 00000100:00100000:0.0:1784936634.882823:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 213 00000100:00100000:0.0:1784936634.882836:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:8140:x1871641503082496:12345-192.168.204.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784936634.882867:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784936634.882893:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784936634.882897:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784936634.882900:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784936634.882902:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1784936634.885278:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:8140:x1871641503082496:12345-192.168.204.1@tcp:256:mount.lustre.0 Request processed in 2434us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.885292:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 213 00000100:00100000:2.0:1784936634.892057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.894270:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082624 00000100:00100000:0.0:1784936634.894448:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082624 00000100:00100000:0.0:1784936634.894878:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 214 00000100:00100000:0.0:1784936634.894889:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:8140:x1871641503082624:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784936634.894907:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936634.894927:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94c76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.894966:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.894998:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936634.895008:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9097021ed800, rc 0) 00000100:00100000:0.0:1784936634.895083:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8140:x1871641503082624:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 196us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.895090:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 214 00000100:00100000:2.0:1784936634.901791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.901980:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082752 00000100:00100000:0.0:1784936634.901989:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082752 00000100:00100000:0.0:1784936634.902038:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:0.0:1784936634.902047:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8140:x1871641503082752:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784936634.902338:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8140:x1871641503082752:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 290us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.902347:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:1.0:1784936634.904684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.905154:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503082880 00000100:00100000:0.0:1784936634.905166:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503082880 00000100:00100000:0.0:1784936634.905229:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:0.0:1784936634.905238:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8140:x1871641503082880:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784936634.905544:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8140:x1871641503082880:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 306us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.905553:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:2.0:1784936634.913849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936634.913962:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083008 00000100:00100000:3.0:1784936634.913973:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083008 00000100:00100000:3.0:1784936634.914035:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:3.0:1784936634.914045:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8148:x1871641503083008:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784936634.914310:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8148:x1871641503083008:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 265us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936634.914320:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:2.0:1784936634.920656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936634.921909:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083136 00000100:00100000:3.0:1784936634.921926:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083136 00000100:00100000:3.0:1784936634.921983:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:3.0:1784936634.921993:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8148:x1871641503083136:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784936634.922302:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:8148:x1871641503083136:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 309us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936634.922311:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:1.0:1784936634.930509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936634.930616:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083264 00000100:00100000:0.0:1784936634.930628:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083264 00000100:00100000:0.0:1784936634.930683:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1784936634.930692:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2370:x1871641503083264:12345-192.168.204.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784936634.930755:0:6621:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from cb536a61-e7ff-45d6-aca9-5836b499d8d1@192.168.204.1@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1784936634.930799:0:6621:0:(genops.c:1406:class_connect()) connect: client cb536a61-e7ff-45d6-aca9-5836b499d8d1, cookie 0x6cf7a864723f5976 00000004:00100000:0.0:1784936634.930832:0:6621:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784936634.931101:0:6621:0:(import.c:65:import_set_state_nolock()) ffff9096edf2f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936634.931186:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2370:x1871641503083264:12345-192.168.204.1@tcp:38:mount.lustre.0 Request processed in 493us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.931195:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:2.0:1784936634.933925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936634.933970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936634.934086:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083520 00000100:00100000:3.0:1784936634.934097:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083520 00000100:00100000:3.0:1784936634.934221:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083392 00000100:00100000:3.0:1784936634.934225:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083392 00000100:00080000:2.0:1784936634.934306:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936634.939594:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1784936634.939622:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+7:8140:x1871641503083520:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784936634.939905:0:6621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784936634.940183:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+7:8140:x1871641503083520:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 573us (6265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936634.940192:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1784936634.940235:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936634.940245:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:0:x1871641503083392:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784936634.940272:0:6621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784936634.940302:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:0:x1871641503083392:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 59us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936634.940309:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:2.0:1784936634.943189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936634.943302:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083648 00000100:00100000:1.0:1784936634.943313:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083648 00000100:00100000:1.0:1784936634.943374:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:1.0:1784936634.943403:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:8140:x1871641503083648:12345-192.168.204.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784936634.943529:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:8140:x1871641503083648:12345-192.168.204.1@tcp:40:mount.lustre.0 Request processed in 127us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936634.943538:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:2.0:1784936634.949812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936634.949920:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936634.955400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936634.955590:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084032 00000100:00100000:1.0:1784936634.955601:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084032 00000100:00100000:1.0:1784936634.955666:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:1.0:1784936634.955677:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:8140:x1871641503084032:12345-192.168.204.1@tcp:33:mount.lustre.0 00000004:00200000:1.0:1784936634.956011:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784936634.956154:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:8140:x1871641503084032:12345-192.168.204.1@tcp:33:mount.lustre.0 Request processed in 479us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936634.956162:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:0.0:1784936634.957942:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083776 00000100:00100000:0.0:1784936634.957957:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083776 00000100:00100000:1.0:1784936634.958062:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503083904 00000100:00100000:1.0:1784936634.958067:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503083904 00000100:00100000:1.0:1784936634.958101:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936634.958110:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1871641503083776:12345-192.168.204.1@tcp:8:mount.lustre.0 00000100:00100000:0.0:1784936634.958140:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00010000:00080000:1.0:1784936634.958145:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from cb536a61-e7ff-45d6-aca9-5836b499d8d1@192.168.204.1@tcp t0 exp 0000000000000000 cur 300 last 0 00000100:00100000:0.0:1784936634.958146:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2370:x1871641503083904:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784936634.958163:0:6598:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from cb536a61-e7ff-45d6-aca9-5836b499d8d1@192.168.204.1@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:1.0:1784936634.958179:0:6597:0:(genops.c:1406:class_connect()) connect: client cb536a61-e7ff-45d6-aca9-5836b499d8d1, cookie 0x6cf7a864723f597d 00000020:00000080:0.0:1784936634.958182:0:6598:0:(genops.c:1406:class_connect()) connect: client cb536a61-e7ff-45d6-aca9-5836b499d8d1, cookie 0x6cf7a864723f5984 00002000:00100000:1.0:1784936634.958191:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cb536a61-e7ff-45d6-aca9-5836b499d8d1/ffff9096ef1ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784936634.958191:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cb536a61-e7ff-45d6-aca9-5836b499d8d1/ffff9096edf2b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784936634.958202:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1784936634.958222:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784936634.958425:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1784936634.958444:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784936634.958477:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1784936634.958477:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9096edf2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936634.958543:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2370:x1871641503083904:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 395us (8622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936634.958551:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:1.0:1784936634.958651:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2370:x1871641503083776:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 541us (8851us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936634.958659:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00010000:00010000:1.0:1784936635.721070:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936636.752706:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936637.770384:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784936637.892474:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000001:00100000:3.0:1784936637.901402:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000100:00100000:0.0:1784936638.347744:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784936638.347771:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524087296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936638.347844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936638.347929:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087296 00000100:00100000:0.0:1784936638.347939:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087296 00000100:00100000:0.0:1784936638.348000:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784936638.348010:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524087296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936638.348049:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936638.348096:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524087296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936638.348103:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1784936638.348159:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efb100 x1871641524087296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936638.348179:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524087296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784936638.348221:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1784936638.441992:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb536a61-e7ff-45d6-aca9-5836b499d8d1 00010000:00010000:1.0:1784936638.797186:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936639.818906:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936639.881755:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524087424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936639.882250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936639.882358:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087424 00000100:00100000:0.0:1784936639.882369:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087424 00000100:00100000:0.0:1784936639.882459:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784936639.882471:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524087424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936639.882532:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936639.882586:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524087424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936639.882594:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1784936639.882621:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784936639.882660:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efb100 x1871641524087424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936639.882701:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524087424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936639.884921:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524087680:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936639.885068:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784936639.885074:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524087552:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936639.885145:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524088064:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936639.885205:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087680 00000100:00100000:3.0:1784936639.885214:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087680 00000100:00100000:3.0:1784936639.885270:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088064 00000100:00100000:3.0:1784936639.885273:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088064 00000100:00100000:3.0:1784936639.885307:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784936639.885317:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524087680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885383:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524087680:12345-0@lo:400:kworker.0 Request processed in 66us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936639.885391:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784936639.885412:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784936639.885419:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524088064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885475:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524088064:12345-0@lo:400:kworker.0 Request processed in 57us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936639.885482:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784936639.885624:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087552 00000100:00100000:3.0:1784936639.885629:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087552 00000100:00100000:3.0:1784936639.885655:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784936639.885661:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524087552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885693:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524087552:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936639.885713:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784936639.885760:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524087808:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936639.885865:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936639.885872:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524087936:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784936639.885925:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936639.885955:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524087552:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885970:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524088064:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.885981:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524087680:0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.886005:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087808 00000100:00100000:3.0:1784936639.886008:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087808 00000100:00100000:3.0:1784936639.886032:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784936639.886038:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524087808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936639.886069:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524087808:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936639.886075:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1784936639.886089:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936639.886103:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524087808:0@lo:400:kworker.0 00000100:00100000:0.0:1784936639.886283:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524087936 00000100:00100000:0.0:1784936639.886289:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524087936 00000100:00100000:0.0:1784936639.886328:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784936639.886336:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936639.886377:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524087936:12345-0@lo:400:kworker.0 Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936639.886384:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1784936639.886699:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf5a300 x1871641524087936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936639.886712:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524087936:0@lo:400:kworker.0 00000001:02000400:2.0:1784936640.138365:0:10179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1784936640.447495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936640.447558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936640.447569:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084160 00000100:00100000:1.0:1784936640.447585:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084160 00000100:00100000:3.0:1784936640.447590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936640.447615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936640.447642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936640.447668:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084416 00000100:00100000:3.0:1784936640.447672:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084416 00000100:00100000:3.0:1784936640.447721:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084288 00000100:00100000:3.0:1784936640.447725:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084288 00000100:00100000:1.0:1784936640.447726:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:1.0:1784936640.447741:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503084160:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936640.447760:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:3.0:1784936640.447770:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503084416:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936640.448094:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503084160:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 356us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936640.448115:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:3.0:1784936640.449703:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503084416:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 1921us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936640.449718:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:3.0:1784936640.449898:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1784936640.449915:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503084288:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936640.449974:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503084288:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 67us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936640.449982:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1784936640.450261:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084672 00000100:00100000:3.0:1784936640.450273:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084672 00000100:00100000:3.0:1784936640.450334:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084544 00000100:00100000:3.0:1784936640.450338:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084544 00000100:00100000:3.0:1784936640.450369:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1784936640.450377:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503084672:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936640.450410:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503084672:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 34us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936640.450418:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1784936640.450472:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:3.0:1784936640.450491:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503084544:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936640.450524:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503084544:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 34us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936640.450530:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00080000:3.0:1784936640.450559:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936640.450564:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784936640.450567:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936640.840974:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936641.874644:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936642.891125:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936643.465994:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936643.466019:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936643.466102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936643.466211:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088192 00000100:00100000:2.0:1784936643.466220:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088192 00000100:00080000:3.0:1784936643.466264:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936643.466286:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784936643.466298:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524088192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784936643.466346:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936643.466414:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524088192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936643.466458:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1784936643.466481:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096fb2f9c00 x1871641524088192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936643.466501:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524088192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936643.912605:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936644.937490:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936645.000835:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784936645.001061:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524088320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936645.001144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936645.003781:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524088576:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.003860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936645.003899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936645.003905:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524088704:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.003941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936645.003980:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088576 00000100:00100000:1.0:1784936645.003988:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088576 00000100:00100000:1.0:1784936645.004050:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088704 00000100:00100000:1.0:1784936645.004054:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088704 00000100:00100000:1.0:1784936645.004086:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784936645.004095:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524088576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004156:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524088576:12345-0@lo:400:kworker.0 Request processed in 61us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.004163:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784936645.004181:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784936645.004186:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524088704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004211:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524088704:12345-0@lo:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.004216:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1784936645.004237:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936645.004251:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524088832:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936645.004299:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784936645.004305:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524088448:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936645.004360:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524088960:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936645.004410:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088832 00000100:00100000:1.0:1784936645.004414:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088832 00000100:00100000:1.0:1784936645.004477:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784936645.004485:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524088832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004521:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524088832:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.004527:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784936645.004544:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088448 00000100:00100000:1.0:1784936645.004547:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088448 00000100:00100000:1.0:1784936645.004573:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784936645.004589:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524088448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004620:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524088448:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.004626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:1.0:1784936645.004659:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936645.004685:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524088448:0@lo:400:kworker.0 00010000:00080000:1.0:1784936645.004705:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede90000 x1871641524088832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936645.004717:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524088832:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004750:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524088704:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004761:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524088576:0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004793:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088960 00000100:00100000:1.0:1784936645.004797:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088960 00000100:00100000:1.0:1784936645.004827:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784936645.004834:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524088960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936645.004871:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524088960:12345-0@lo:400:kworker.0 Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.004877:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1784936645.004894:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936645.004912:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524088960:0@lo:400:kworker.0 00000100:00100000:2.0:1784936645.007576:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524088320 00000100:00100000:2.0:1784936645.007591:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524088320 00000100:00100000:3.0:1784936645.009258:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784936645.009271:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524088320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936645.009312:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936645.009402:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524088320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (8260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936645.009408:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1784936645.009476:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efad80 x1871641524088320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936645.009497:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524088320:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784936645.009910:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784936645.562315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936645.562369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936645.562395:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084928 00000100:00100000:1.0:1784936645.562406:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084928 00000100:00100000:2.0:1784936645.562425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936645.562492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936645.562729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936645.562746:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085056 00000100:00100000:1.0:1784936645.562752:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085056 00000100:00100000:2.0:1784936645.562774:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:1.0:1784936645.562791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:2.0:1784936645.562793:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503084928:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936645.562811:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085056:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936645.562894:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503084800 00000100:00100000:3.0:1784936645.562899:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503084800 00000100:00100000:3.0:1784936645.562940:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 222 00000100:00100000:3.0:1784936645.562947:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503084800:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936645.563572:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085056:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 761us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.563580:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:1.0:1784936645.563622:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085184 00000100:00100000:1.0:1784936645.563626:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085184 00000100:00100000:1.0:1784936645.563656:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085312 00000100:00100000:1.0:1784936645.563658:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085312 00000100:00100000:1.0:1784936645.563694:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:1.0:1784936645.563702:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503085184:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936645.563733:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503085184:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 32us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.563738:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:1.0:1784936645.563749:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:1.0:1784936645.563755:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085312:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936645.563779:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085312:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 23us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936645.563784:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00080000:1.0:1784936645.563819:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936645.563823:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784936645.563826:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936645.564085:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503084928:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 1300us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936645.564094:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:3.0:1784936645.569992:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503084800:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 7021us (7600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936645.570019:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 222 00010000:00010000:0.0:1784936645.960593:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936646.985142:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936648.009610:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936648.585701:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784936648.585749:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524089088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936648.585858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936648.586053:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089088 00000100:00100000:3.0:1784936648.586064:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089088 00000100:00100000:3.0:1784936648.586143:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784936648.586156:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524089088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936648.586202:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936648.586261:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524089088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936648.586269:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1784936648.586696:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096d0115f80 x1871641524089088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936648.586718:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524089088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784936648.588300:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784936649.032707:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936650.057544:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936650.121300:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524089216:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.121385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936650.121457:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524089728:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.121488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936650.121521:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784936650.121529:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524089600:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.122750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936650.122814:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524089344:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.122849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936650.122875:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524089856:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.122901:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936650.122943:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784936650.122953:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524089472:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.122983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936650.123029:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089216 00000100:00100000:1.0:1784936650.123038:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089216 00000100:00100000:1.0:1784936650.123097:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784936650.123122:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524089216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123186:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524089216:12345-0@lo:400:kworker.0 Request processed in 68us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936650.123195:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784936650.123239:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089728 00000100:00100000:1.0:1784936650.123244:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089728 00000100:00100000:1.0:1784936650.123284:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089344 00000100:00100000:1.0:1784936650.123287:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089344 00000100:00100000:1.0:1784936650.123304:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089472 00000100:00100000:1.0:1784936650.123307:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089472 00000100:00100000:1.0:1784936650.123327:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784936650.123346:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524089728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123386:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524089728:12345-0@lo:400:kworker.0 Request processed in 42us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936650.123394:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784936650.123413:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784936650.123421:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524089344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123476:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524089344:12345-0@lo:400:kworker.0 Request processed in 57us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936650.123484:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784936650.123503:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784936650.123510:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524089472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123556:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524089472:12345-0@lo:400:kworker.0 Request processed in 46us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936650.123564:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784936650.123590:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089600 00000100:00100000:1.0:1784936650.123593:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089600 00000100:00100000:1.0:1784936650.123627:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089856 00000100:00100000:1.0:1784936650.123630:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089856 00000100:00100000:1.0:1784936650.123654:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784936650.123662:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524089600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123712:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524089600:12345-0@lo:400:kworker.0 Request processed in 50us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936650.123720:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784936650.123738:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784936650.123750:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524089856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123782:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524089856:12345-0@lo:400:kworker.0 Request processed in 33us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936650.123795:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784936650.123864:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524089472:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123880:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524089344:0@lo:400:kworker.0 00010000:00080000:1.0:1784936650.123898:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ec849c00 x1871641524089856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936650.123909:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524089856:0@lo:400:kworker.0 00010000:00080000:1.0:1784936650.123963:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ec84b480 x1871641524089600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936650.123972:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524089600:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123981:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524089216:0@lo:400:kworker.0 00000100:00100000:1.0:1784936650.123990:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524089728:0@lo:400:kworker.0 00000100:00080000:1.0:1784936650.124035:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936650.124039:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784936650.124042:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936650.124086:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784936650.124094:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524089984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936650.124121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936650.125175:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524089984 00000100:00100000:3.0:1784936650.125184:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524089984 00000100:00100000:3.0:1784936650.125236:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784936650.125245:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524089984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936650.125276:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936650.125330:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524089984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936650.125349:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1784936650.125382:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ec848700 x1871641524089984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936650.125399:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524089984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936650.677967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936650.678073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936650.678109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936650.678131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936650.678156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936650.678186:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085824 00000100:00100000:2.0:1784936650.678195:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085824 00000100:00100000:2.0:1784936650.678250:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085952 00000100:00100000:2.0:1784936650.678253:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085952 00000100:00100000:2.0:1784936650.678293:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1784936650.678303:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085824:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936650.678391:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085824:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 88us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936650.678401:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1784936650.678418:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:2.0:1784936650.678447:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085952:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936650.678485:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085952:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936650.678492:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:2.0:1784936650.678509:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085440 00000100:00100000:2.0:1784936650.678513:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085440 00000100:00100000:2.0:1784936650.678538:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:2.0:1784936650.678544:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503085440:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936650.679108:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085568 00000100:00100000:3.0:1784936650.679115:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085568 00000100:00100000:3.0:1784936650.679158:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503085696 00000100:00100000:3.0:1784936650.679161:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503085696 00000100:00100000:3.0:1784936650.679202:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:0.0:1784936650.679212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:3.0:1784936650.679213:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503085568:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936650.679228:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085696:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936650.679256:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503085568:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 45us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936650.679263:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:0.0:1784936650.679269:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503085696:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 45us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936650.679288:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:2.0:1784936650.681108:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503085440:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 2553us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936650.681120:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00080000:2.0:1784936650.681175:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784936650.681181:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784936650.681184:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784936651.086344:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936652.107904:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936653.128777:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936653.706557:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524090112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936653.706625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936653.706708:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090112 00000100:00100000:0.0:1784936653.706715:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090112 00000100:00100000:0.0:1784936653.706770:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784936653.706779:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524090112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936653.706815:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936653.706870:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524090112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936653.706877:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1784936653.706896:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784936653.706920:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4ef9f80 x1871641524090112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936653.706938:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524090112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936654.153047:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936655.177007:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936655.241126:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936655.241213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936655.241279:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524090752:0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.241304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936655.241329:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784936655.241335:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524090624:0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.241357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936655.241388:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090752 00000100:00100000:2.0:1784936655.241394:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090752 00000100:00100000:2.0:1784936655.241469:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784936655.241478:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524090752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.241545:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524090752:12345-0@lo:400:kworker.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.241553:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784936655.241575:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090624 00000100:00100000:2.0:1784936655.241579:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090624 00000100:00100000:2.0:1784936655.241606:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784936655.241612:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524090624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.241651:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524090624:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.241668:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1784936655.241687:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784936655.241692:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936655.241725:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524090624:0@lo:400:kworker.0 00010000:00080000:2.0:1784936655.241738:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c4efa680 x1871641524090752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936655.241747:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524090752:0@lo:400:kworker.0 00000100:00100000:0.0:1784936655.241986:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090240 00000100:00100000:0.0:1784936655.241991:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090240 00000100:00100000:0.0:1784936655.242030:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784936655.242038:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524090240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936655.242068:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936655.242105:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524090240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936655.242111:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784936655.242325:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524090368:0@lo:400:kworker.0 00000100:00100000:1.0:1784936655.242359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936655.242396:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524090880:0@lo:400:kworker.0 00000100:00100000:1.0:1784936655.242419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936655.242464:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784936655.242470:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524090496:0@lo:400:kworker.0 00000100:00080000:2.0:1784936655.242830:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936655.242882:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090368 00000100:00100000:0.0:1784936655.242887:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090368 00000100:00100000:0.0:1784936655.242918:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784936655.242924:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524090368:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784936655.247082:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ec848700 x1871641524090240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936655.247113:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936655.247194:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090880 00000100:00100000:2.0:1784936655.247202:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090880 00000100:00100000:2.0:1784936655.247294:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784936655.247302:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524090880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.247388:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524090880:12345-0@lo:400:kworker.0 Request processed in 86us (4968us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.247395:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1784936655.247540:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936655.247777:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524090368:12345-0@lo:400:kworker.0 Request processed in 4850us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936655.247787:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1784936655.250418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936655.250564:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524091008:0@lo:400:kworker.0 00000100:00100000:1.0:1784936655.250603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936655.250702:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524090368:0@lo:400:kworker.0 00000100:00100000:1.0:1784936655.250720:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524090880:0@lo:400:kworker.0 00000100:00100000:3.0:1784936655.254268:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524091008 00000100:00100000:3.0:1784936655.254284:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524091008 00000100:00100000:3.0:1784936655.254372:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784936655.254382:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524091008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936655.254504:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524091008:12345-0@lo:400:kworker.0 Request processed in 123us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936655.254513:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1784936655.254743:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5942300 x1871641524091008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936655.254759:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524091008:0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.254901:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524090496 00000100:00100000:2.0:1784936655.254907:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524090496 00000100:00100000:2.0:1784936655.254985:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784936655.254993:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524090496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936655.255046:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524090496:12345-0@lo:400:kworker.0 Request processed in 54us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.255053:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784936655.255122:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524090496:0@lo:400:kworker.0 00000100:00100000:1.0:1784936655.797800:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936655.798018:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086080 00000100:00100000:2.0:1784936655.798030:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086080 00000100:00100000:2.0:1784936655.798092:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 226 00000100:00100000:2.0:1784936655.798113:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503086080:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936655.802383:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503086080:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 4269us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.802399:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 226 00000100:00100000:1.0:1784936655.802578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936655.803463:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086336 00000100:00100000:2.0:1784936655.803474:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086336 00000100:00100000:2.0:1784936655.803554:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:2.0:1784936655.803566:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503086336:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936655.803603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936655.803651:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503086336:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 87us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.803658:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:2.0:1784936655.803672:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086208 00000100:00100000:2.0:1784936655.803675:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086208 00000100:00100000:2.0:1784936655.803957:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:2.0:1784936655.803966:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503086208:12345-192.168.204.1@tcp:400:kworker.0 00000100:00080000:3.0:1784936655.804093:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936655.807230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936655.809001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936655.810965:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2374:x1871641503086208:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 6124us (6489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936655.810985:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:3.0:1784936655.826862:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086464 00000100:00100000:3.0:1784936655.826877:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086464 00000100:00100000:2.0:1784936655.827006:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086592 00000100:00100000:2.0:1784936655.827012:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086592 00000100:00100000:3.0:1784936655.827090:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1784936655.827102:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2370:x1871641503086464:12345-192.168.204.1@tcp:9:kworker.0 00000100:00080000:0.0:1784936655.827131:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1784936655.827137:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f597d 00000100:00080000:0.0:1784936655.827137:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936655.827149:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784936655.827173:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784936655.829316:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784936655.834881:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+2:2370:x1871641503086464:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 7768us (27648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936655.834895:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1784936655.835838:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:3.0:1784936655.835854:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2370:x1871641503086592:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:3.0:1784936655.835908:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5984 00000100:00080000:3.0:1784936655.835916:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096edf2f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784936655.835959:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784936655.836175:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+2:2370:x1871641503086592:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 326us (27183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936655.838012:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00010000:00010000:3.0:1784936655.839899:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936656.206287:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784936656.722834:0:10881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784936657.225408:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936658.248754:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784936658.379295:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000020:00000080:0.0:1784936658.379305:0:7508:0:(genops.c:906:class_export_put()) final put ffff9096edf2b800/cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000001:00100000:3.0:1784936658.383555:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000020:00000080:3.0:1784936658.383565:0:6623:0:(genops.c:906:class_export_put()) final put ffff9096ef1ed000/cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000020:00000080:2.0:1784936658.383816:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096edf2b800/cb536a61-e7ff-45d6-aca9-5836b499d8d1 for lustre-OST0001 00000020:00000080:2.0:1784936658.383916:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096edf2f800 for lustre-OST0001 00000020:00000080:3.0:1784936658.394175:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1ed000/cb536a61-e7ff-45d6-aca9-5836b499d8d1 for lustre-OST0000 00000020:00000080:3.0:1784936658.394243:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1eb800 for lustre-OST0000 00000100:00100000:0.0:1784936658.824978:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524091136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936658.825055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936658.825134:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524091136 00000100:00100000:0.0:1784936658.825142:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524091136 00000100:00100000:0.0:1784936658.825194:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784936658.825203:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524091136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936658.825237:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936658.825277:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524091136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936658.825284:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1784936658.825303:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784936658.825332:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5941f80 x1871641524091136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936658.825349:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524091136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784936659.272899:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784936660.068617:0:11031:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0d426120 20000000:00000080:1.0:1784936660.068634:0:11031:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9096ff3e7400 uarg=0000000000000000 20000000:01000000:1.0:1784936660.068670:0:11031:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784936660.068676:0:11031:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784936660.068680:0:11031:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784936660.070025:0:11032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784936660.070161:0:11031:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784936660.083027:0:11031:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784936660.083057:0:11031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083091:0:11031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083109:0:11031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f593e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083116:0:11031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f594c expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083126:0:11031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083132:0:11031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083332:0:11031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083377:0:11031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.083393:0:11031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 12 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936660.083409:0:11031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec84a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091264:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936660.086596:0:11031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.086628:0:11031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 12 pid: 5788 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936660.086642:0:11031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091392:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936660.086679:0:11031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f594c expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.086688:0:11031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f594c expref: 18 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936660.086698:0:11031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091520:0@lo:104: 00000100:00100000:0.0:1784936660.086744:0:11031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784936660.086783:0:11031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f593e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.086791:0:11031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f593e expref: 18 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936660.086799:0:11031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5942d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091648:0@lo:104: 00000100:00100000:0.0:1784936660.086832:0:11031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.086865:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524091520 00000100:00100000:0.0:1784936660.086872:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524091520 00000100:00100000:0.0:1784936660.086906:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524091648 00000100:00100000:0.0:1784936660.086908:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524091648 00000100:00100000:0.0:1784936660.086921:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784936660.086928:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5940000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:11031:x1871641524091520:12345-0@lo:104: 00010000:00010000:0.0:1784936660.086956:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087014:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936660.087021:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5940000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:11031:x1871641524091520:12345-0@lo:104: Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.087028:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784936660.087044:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784936660.087050:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:11031:x1871641524091648:12345-0@lo:104: 00010000:00010000:0.0:1784936660.087058:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087090:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784936660.087095:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:11031:x1871641524091648:12345-0@lo:104: Request processed in 46us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.087100:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1784936660.087117:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784936660.087123:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087131:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd600 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936660.087135:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087144:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936660.087151:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936660.087163:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784936660.087191:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087197:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936660.087213:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087219:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fd600/0x6cf7a864723f594c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087233:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936660.087236:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087241:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021ed600 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936660.087244:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087251:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936660.087257:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936660.087262:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784936660.087274:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087280:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936660.087300:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087306:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9097021ed600/0x6cf7a864723f593e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087315:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936660.087317:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936660.087318:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936660.087340:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524091776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784936660.087372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.087407:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524091776 00000100:00100000:0.0:1784936660.087411:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524091776 00010000:00010000:0.0:1784936660.087449:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f594c expref: 19 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936660.087469:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784936660.087475:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524091776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784936660.087484:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936660.087490:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f594c expref: 19 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087498:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f594c expref: 19 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087513:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936660.087539:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524091776:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.087545:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784936660.087598:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524091776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784936660.087634:0:11031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087641:0:11031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 18 pid: 5791 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936660.087650:0:11031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524092032:0@lo:104: 00000100:00100000:0.0:1784936660.087670:0:11031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.087688:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092032 00000100:00100000:0.0:1784936660.087691:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092032 00000100:00100000:0.0:1784936660.087708:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784936660.087714:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:11031:x1871641524092032:12345-0@lo:104: 00010000:00010000:0.0:1784936660.087721:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087765:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936660.087770:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:11031:x1871641524092032:12345-0@lo:104: Request processed in 57us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.087776:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784936660.087788:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936660.087792:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087798:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936660.087801:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087807:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936660.087825:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936660.087830:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784936660.087849:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087855:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936660.087862:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087868:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096f4d18c00/0x6cf7a864723f5930 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f5937 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.087881:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936660.087883:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936660.087884:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936660.087897:0:11031:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c82cccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1784936660.087911:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9097021edc00/0x6cf7a864723f5953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f594c expref: 18 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936660.087920:0:11031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091520:0@lo:104: 00000100:00100000:0.0:1784936660.087927:0:11031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5942d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091648:0@lo:104: 00000100:00100000:0.0:1784936660.087933:0:11031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524092032:0@lo:104: 00000100:00100000:2.0:1784936660.088415:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524092160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936660.088468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936660.088500:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936660.088506:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524091904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936660.088523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936660.088544:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092160 00000100:00100000:2.0:1784936660.088547:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092160 00010000:00010000:2.0:1784936660.088564:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 18 pid: 5791 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936660.088576:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524091904 00000100:00100000:2.0:1784936660.088579:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524091904 00010000:00010000:2.0:1784936660.088589:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f593e expref: 19 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936660.088600:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784936660.088617:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524092160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936660.088626:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936660.088630:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 19 pid: 5791 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.088639:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 19 pid: 5791 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.088650:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9097021eca00/0x6cf7a864723f5937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f5930 expref: 19 pid: 5791 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.088662:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936660.088689:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+18:3308:x1871641524092160:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936660.088706:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784936660.088719:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784936660.088737:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+17:3308:x1871641524091904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936660.088745:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936660.088750:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f593e expref: 17 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.088759:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f593e expref: 17 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.088769:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9097021ec400/0x6cf7a864723f5945 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f593e expref: 17 pid: 5788 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.088778:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936660.088801:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+16:3308:x1871641524091904:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936660.088806:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784936660.088843:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524091904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936660.088851:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524092160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936660.089502:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936660.095764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936660.095802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936660.096011:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086720 00000100:00100000:2.0:1784936660.096021:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086720 00010000:00010000:2.0:1784936660.096059:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 13 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936660.096096:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086848 00000100:00100000:2.0:1784936660.096107:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086848 00010000:00010000:2.0:1784936660.096120:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 14 pid: 5788 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936660.096149:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:2.0:1784936660.096157:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d96f7a08-a761-4b50-baa8-3dae75dc18da+14:2371:x1871641503086720:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936660.096171:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936660.096177:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 14 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096190:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 14 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096209:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936660.096255:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d96f7a08-a761-4b50-baa8-3dae75dc18da+14:2371:x1871641503086720:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 98us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936660.096263:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:2.0:1784936660.096279:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:2.0:1784936660.096285:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503086848:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936660.096293:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936660.096298:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 13 pid: 5788 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096308:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 13 pid: 5788 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096320:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096329:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096349:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096357:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096364:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096371:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096378:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936660.096382:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096391:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096399:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936660.096407:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936660.096462:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503086848:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 140us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936660.096470:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00010000:00010000:1.0:1784936660.097118:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9097021ed800/0x6cf7a864723f596f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c76 expref: 12 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936660.097145:0:11031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec84a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091264:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936660.097163:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4c00/0x6cf7a864723f595a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c3e expref: 11 pid: 5788 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936660.097172:0:11031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11031:1871641524091392:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936660.097200:0:11031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.097208:0:11031:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.097215:0:11031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936660.097221:0:11031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fd400/0x6cf7a864723f598b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936660.298156:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936660.360890:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524092288:0@lo:400:kworker.0 00000100:00100000:0.0:1784936660.361086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.361138:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524092800:0@lo:400:kworker.0 00000100:00100000:0.0:1784936660.361167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.361194:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784936660.361203:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524092416:0@lo:400:kworker.0 00000100:00100000:0.0:1784936660.361230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.361249:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524092928:0@lo:400:kworker.0 00000100:00100000:0.0:1784936660.361273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936660.361310:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092288 00000100:00100000:0.0:1784936660.361318:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092288 00000100:00100000:0.0:1784936660.361366:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784936660.361377:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:3305:x1871641524092288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936660.361452:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+16:3305:x1871641524092288:12345-0@lo:400:kworker.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.361460:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784936660.361517:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524092288:0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.362234:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524092544:0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.362274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936660.362302:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784936660.362309:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524092672:0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.362336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936660.362369:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092800 00000100:00100000:1.0:1784936660.362375:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092800 00000100:00100000:1.0:1784936660.362417:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092416 00000100:00100000:1.0:1784936660.362421:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092416 00000100:00100000:1.0:1784936660.362465:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092544 00000100:00100000:1.0:1784936660.362469:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092544 00000100:00100000:1.0:1784936660.362500:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784936660.362507:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524092800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.362558:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524092800:12345-0@lo:400:kworker.0 Request processed in 51us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.362565:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784936660.362579:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784936660.362585:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524092416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.362616:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524092416:12345-0@lo:400:kworker.0 Request processed in 31us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.362621:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784936660.362632:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784936660.362639:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524092544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.362942:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524092544:12345-0@lo:400:kworker.0 Request processed in 303us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.362950:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784936660.362978:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092928 00000100:00100000:1.0:1784936660.362982:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092928 00000100:00100000:1.0:1784936660.363010:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524092672 00000100:00100000:1.0:1784936660.363012:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524092672 00000100:00100000:1.0:1784936660.363422:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784936660.363481:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524092928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.363525:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524092928:12345-0@lo:400:kworker.0 Request processed in 96us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.363533:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784936660.363547:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784936660.363554:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524092672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.363593:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524092672:12345-0@lo:400:kworker.0 Request processed in 41us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.363600:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1784936660.364121:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784936660.364126:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936660.364129:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936660.364143:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524093056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936660.364177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784936660.364215:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf5b100 x1871641524092672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936660.364227:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524092672:0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.364238:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524092544:0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.364268:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093056 00000100:00100000:1.0:1784936660.364272:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093056 00000100:00100000:1.0:1784936660.364302:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784936660.364308:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524093056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784936660.364336:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936660.364370:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524093056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.364377:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1784936660.364401:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096d0116a00 x1871641524093056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936660.364413:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524093056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936660.364455:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524092416:0@lo:400:kworker.0 00010000:00080000:1.0:1784936660.364476:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf59180 x1871641524092928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936660.364483:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524092928:0@lo:400:kworker.0 00000100:00100000:1.0:1784936660.364493:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524092800:0@lo:400:kworker.0 00000100:00100000:0.0:1784936660.916825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936660.917367:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503086976 00000100:00100000:1.0:1784936660.917382:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503086976 00000100:00100000:1.0:1784936660.917504:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 228 00000100:00100000:1.0:1784936660.917519:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2371:x1871641503086976:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936660.917631:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2371:x1871641503086976:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 117us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936660.917640:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 228 00000100:00100000:0.0:1784936660.919246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936660.919294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936660.919335:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087104 00000100:00100000:0.0:1784936660.919347:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087104 00000100:00100000:0.0:1784936660.919421:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087232 00000100:00100000:0.0:1784936660.919453:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087232 00000100:00100000:0.0:1784936660.919491:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:0.0:1784936660.919502:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503087104:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936660.919582:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503087104:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 82us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.919605:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:0.0:1784936660.919622:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:0.0:1784936660.919628:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2371:x1871641503087232:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936660.919653:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2371:x1871641503087232:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936660.919660:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00080000:0.0:1784936660.919676:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936661.243088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936661.243663:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087360 00000100:00100000:0.0:1784936661.243677:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087360 00000100:00100000:0.0:1784936661.243763:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:0.0:1784936661.243775:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:5591:x1871641503087360:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936661.243801:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936661.243829:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ca0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936661.243866:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936661.243879:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936661.243891:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26aa00, rc 0) 00000100:00100000:0.0:1784936661.243981:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503087360:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 207us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936661.243989:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:1.0:1784936661.264050:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936661.264208:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087488 00000100:00100000:0.0:1784936661.264240:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087488 00000100:00100000:0.0:1784936661.264520:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 230 00000100:00100000:0.0:1784936661.264534:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503087488:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936661.264917:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503087488:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 385us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936661.264939:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 230 00000100:00100000:2.0:1784936661.276718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936661.276903:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087616 00000100:00100000:1.0:1784936661.276919:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087616 00000100:00100000:1.0:1784936661.276993:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:1.0:1784936661.277005:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503087616:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936661.278889:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503087616:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 1871us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936661.278906:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:2.0:1784936661.291909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936661.294258:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087744 00000100:00100000:0.0:1784936661.294284:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087744 00000100:00100000:0.0:1784936661.294489:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 232 00000100:00100000:0.0:1784936661.294502:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503087744:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936661.294528:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936661.294694:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ca7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936661.294750:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936661.294764:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936661.294776:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b800, rc 0) 00000100:00100000:0.0:1784936661.294864:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503087744:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 365us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936661.294872:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 232 00000100:00100000:0.0:1784936661.299361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936661.299547:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503087872 00000100:00100000:1.0:1784936661.299562:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503087872 00000100:00100000:1.0:1784936661.299803:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:1.0:1784936661.299818:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503087872:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936661.300254:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503087872:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 439us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936661.300272:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:2.0:1784936661.313163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936661.317467:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088000 00000100:00100000:1.0:1784936661.317489:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088000 00000100:00100000:1.0:1784936661.321245:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 234 00000100:00100000:1.0:1784936661.321276:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503088000:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936661.321631:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503088000:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 369us (8486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936661.321641:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 234 00010000:00010000:0.0:1784936661.329048:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784936661.706147:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784936661.706161:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ffa3c000 from 7 10000000:01000000:1.0:1784936661.706169:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784936661.706241:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936661.706255:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936661.706267:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936661.706303:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784936661.706401:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936661.707595:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c647c840 going to sleep for 11 seconds 00000100:00100000:2.0:1784936661.714746:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093184 00000100:00100000:2.0:1784936661.714766:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093184 00000100:00100000:2.0:1784936661.714854:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784936661.714866:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524093184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936661.714889:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936661.714915:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f59a0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.714953:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.714965:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.714975:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18e00, rc 0) 00000100:00100000:2.0:1784936661.715098:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524093184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (8697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936661.715106:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784936661.715197:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936661.715220:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.715232:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936661.715327:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.715369:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936661.715405:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53240 going to sleep for 11 seconds 00000100:00100000:2.0:1784936661.715461:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093312 00000100:00100000:2.0:1784936661.715466:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093312 00000100:00100000:2.0:1784936661.715492:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784936661.715499:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524093312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.716798:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524093312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1290us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936661.716811:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784936661.716876:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.716940:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.716991:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936661.717009:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53240 going to sleep for 11 seconds 00000100:00100000:2.0:1784936661.717026:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093440 00000100:00100000:2.0:1784936661.717032:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093440 00000100:00100000:2.0:1784936661.717256:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784936661.717265:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524093440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.718256:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524093440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 988us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936661.718267:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784936661.718343:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784936661.723286:0:11066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784936661.724191:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784936661.724224:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784936661.724241:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936661.724255:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936661.724267:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784936661.724270:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096f4d33000 from 7 10000000:01000000:3.0:1784936661.724273:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784936661.724326:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936661.724336:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936661.724363:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936661.724397:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784936661.724833:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936661.724892:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936661.724910:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093568 00000100:00100000:2.0:1784936661.724920:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093568 00000100:00100000:2.0:1784936661.725229:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784936661.725243:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524093568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936661.725262:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936661.725284:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f59ae expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.725316:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.725330:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.725341:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19200, rc 0) 00000100:00100000:2.0:1784936661.725394:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524093568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936661.725402:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784936661.725506:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936661.725525:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.725537:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936661.725606:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.725632:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936661.725646:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53540 going to sleep for 11 seconds 00000100:00100000:2.0:1784936661.725658:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093696 00000100:00100000:2.0:1784936661.725661:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093696 00000100:00100000:2.0:1784936661.725682:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784936661.725689:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524093696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.726176:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524093696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 485us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936661.726191:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784936661.726227:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.726270:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.726309:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936661.726323:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53540 going to sleep for 11 seconds 00000100:00100000:2.0:1784936661.726337:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093824 00000100:00100000:2.0:1784936661.726341:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093824 00000100:00100000:2.0:1784936661.726369:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784936661.726376:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524093824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.726602:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524093824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936661.726611:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784936661.726652:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784936661.730389:0:11068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784936661.730783:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784936661.730818:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784936661.730834:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.730848:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936661.730861:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784936661.730864:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096d473e000 from 7 10000000:01000000:2.0:1784936661.730866:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784936661.730919:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.730943:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.730958:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936661.730998:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.731098:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936661.731160:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53240 going to sleep for 11 seconds 00000100:00100000:3.0:1784936661.731168:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524093952 00000100:00100000:3.0:1784936661.731180:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524093952 00000100:00100000:3.0:1784936661.731241:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784936661.731253:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524093952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936661.731273:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936661.731290:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f59bc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936661.731321:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936661.731334:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936661.731344:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4200, rc 0) 00000100:00100000:3.0:1784936661.731402:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524093952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936661.731411:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784936661.731618:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524093952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936661.731636:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936661.731646:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936661.731722:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524094080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936661.731749:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936661.731770:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53240 going to sleep for 11 seconds 00000100:00100000:3.0:1784936661.731865:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094080 00000100:00100000:3.0:1784936661.731869:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094080 00000100:00100000:3.0:1784936661.731904:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784936661.731910:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524094080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936661.732216:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524094080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936661.732225:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784936661.732547:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524094080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936661.732592:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524094208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936661.732771:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936661.732811:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c647c840 going to sleep for 11 seconds 00000100:00100000:3.0:1784936661.732895:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094208 00000100:00100000:3.0:1784936661.732901:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094208 00000100:00100000:3.0:1784936661.732931:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784936661.732937:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524094208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936661.733191:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524094208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936661.733198:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784936661.733392:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524094208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784936661.740894:0:11069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784936661.741165:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784936661.741198:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784936661.741216:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936661.741232:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936662.347354:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936663.369260:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936663.948388:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524094336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936663.948522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936663.948677:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094336 00000100:00100000:3.0:1784936663.948688:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094336 00000100:00100000:3.0:1784936663.948772:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784936663.948785:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524094336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936663.948833:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936663.948890:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524094336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936663.948898:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784936663.948964:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf58e00 x1871641524094336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936663.948988:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524094336:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784936663.949247:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784936664.394416:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784936664.862754:0:11229:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784936665.417903:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936665.480890:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524094720:0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.480972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936665.481192:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524094592:0@lo:400:kworker.0 00000100:00100000:3.0:1784936665.481239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936665.481261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936665.481268:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524094464:0@lo:400:kworker.0 00000100:00100000:3.0:1784936665.481314:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936665.481351:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094720 00000100:00100000:3.0:1784936665.481359:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094720 00000100:00100000:3.0:1784936665.481417:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094592 00000100:00100000:3.0:1784936665.481421:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094592 00000100:00100000:3.0:1784936665.481466:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784936665.481475:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524094720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936665.490236:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524094976:0@lo:400:kworker.0 00000100:00100000:0.0:1784936665.490396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936665.490510:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936665.490518:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524095104:0@lo:400:kworker.0 00000100:00100000:0.0:1784936665.490547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936665.495230:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094976 00000100:00100000:1.0:1784936665.495245:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094976 00000100:00100000:1.0:1784936665.495339:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784936665.495350:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.495468:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524094976:12345-0@lo:400:kworker.0 Request processed in 120us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936665.495476:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1784936665.495532:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5941880 x1871641524094976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936665.495566:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524094976:0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.495684:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095104 00000100:00100000:1.0:1784936665.495689:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095104 00000100:00100000:1.0:1784936665.495714:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784936665.495722:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.495760:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524094592:12345-0@lo:400:kworker.0 Request processed in 40us (14521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936665.495766:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784936665.495779:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784936665.495785:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524095104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.495816:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524095104:12345-0@lo:400:kworker.0 Request processed in 33us (5269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936665.495822:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784936665.495844:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524095104:0@lo:400:kworker.0 00000100:00080000:1.0:1784936665.495890:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784936665.495894:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936665.495906:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094464 00000100:00100000:1.0:1784936665.495909:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094464 00000100:00100000:1.0:1784936665.495944:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784936665.495951:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.495982:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524094464:12345-0@lo:400:kworker.0 Request processed in 33us (14668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936665.495988:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784936665.496034:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524094848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936665.496088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936665.496113:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784936665.496119:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524095232:0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.496139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936665.496161:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095232 00000100:00100000:1.0:1784936665.496164:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095232 00000100:00100000:1.0:1784936665.496191:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784936665.496197:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524095232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.496227:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524095232:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936665.496233:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1784936665.496245:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784936665.496260:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5940e00 x1871641524095232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936665.496270:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524095232:0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.496314:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524094464:0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.496325:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524094592:0@lo:400:kworker.0 00000100:00100000:1.0:1784936665.496365:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524094848 00000100:00100000:1.0:1784936665.496368:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524094848 00000100:00100000:1.0:1784936665.496388:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784936665.496395:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524094848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784936665.496422:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936665.496479:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524094848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936665.496485:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1784936665.496513:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096d0117100 x1871641524094848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936665.496527:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524094848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936665.504488:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524094720:12345-0@lo:400:kworker.0 Request processed in 23003us (23506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936665.504504:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784936665.504738:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524094720:0@lo:400:kworker.0 00000100:00100000:0.0:1784936666.043962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936666.044117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936666.044182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936666.044459:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088384 00000100:00100000:3.0:1784936666.044473:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088384 00000100:00100000:3.0:1784936666.044556:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088256 00000100:00100000:3.0:1784936666.044560:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088256 00000100:00100000:3.0:1784936666.044590:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:3.0:1784936666.044604:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503088384:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936666.044672:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:2.0:1784936666.044686:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503088256:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936666.044736:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503088384:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 130us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936666.044746:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00080000:0.0:1784936666.044891:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936666.047826:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088128 00000100:00100000:1.0:1784936666.047847:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088128 00000100:00100000:2.0:1784936666.047850:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503088256:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 3157us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936666.047866:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:1.0:1784936666.047935:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 245 00000100:00100000:1.0:1784936666.047947:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503088128:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936666.048399:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503088128:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 452us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936666.048407:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 245 00010000:00010000:1.0:1784936666.440750:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936667.469797:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936668.490186:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936669.067292:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524095360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936669.067397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936669.067505:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095360 00000100:00100000:3.0:1784936669.067515:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095360 00000100:00100000:3.0:1784936669.067610:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784936669.067633:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524095360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936669.067683:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936669.067736:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524095360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936669.067744:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1784936669.067767:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784936669.067806:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf5b480 x1871641524095360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936669.067841:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524095360:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784936669.210785:0:11331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:44:27 (1784936667) === 00010000:00010000:2.0:1784936669.512906:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936669.563030:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.563134:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088512 00000100:00100000:3.0:1784936669.563149:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088512 00000100:00100000:3.0:1784936669.563258:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1784936669.563275:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503088512:12345-192.168.204.1@tcp:41:mkdir.0 00000004:00000024:3.0:1784936669.563341:0:6621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784936669.563486:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503088512:12345-192.168.204.1@tcp:41:mkdir.0 Request processed in 216us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936669.563494:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00080000:0.0:1784936669.563571:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936669.564153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936669.564233:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088640 00000100:00100000:0.0:1784936669.564239:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088640 00000100:00100000:0.0:1784936669.564285:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1784936669.564295:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:486efceb-7a20-41d5-8389-4305380725bf+6:9693:x1871641503088640:12345-192.168.204.1@tcp:700:mkdir.0 00000100:00100000:0.0:1784936669.564369:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:486efceb-7a20-41d5-8389-4305380725bf+6:9693:x1871641503088640:12345-192.168.204.1@tcp:700:mkdir.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936669.564376:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1784936669.578163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936669.578290:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503088896 00000100:00100000:0.0:1784936669.578305:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503088896 00000100:00100000:0.0:1784936669.578387:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:0.0:1784936669.578399:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:9693:x1871641503088896:12345-192.168.204.1@tcp:36:mkdir.0 00010000:00010000:0.0:1784936669.578515:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936669.583207:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f58ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c29 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.583261:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d173a000) 00010000:00010000:0.0:1784936669.583697:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936669.584141:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.584158:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.584171:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.584211:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.584230:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.584238:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936669.585589:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784936669.585606:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.585614:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.585622:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.585629:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936669.585633:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.585651:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.585664:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59500) 00010000:00010000:2.0:1784936669.585668:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936669.585673:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.585680:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f59ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936669.585702:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7532476 reply state 000000005cbfed8b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936669.585713:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936669.585838:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+7:9693:x1871641503088896:12345-192.168.204.1@tcp:36:mkdir.0 Request processed in 7438us (7687us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784936669.585847:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00010000:00010000:0.0:1784936669.589205:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.589234:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.589241:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.589247:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936669.589252:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.589260:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.589277:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9096d7e59200) 00010000:00010000:0.0:1784936669.589280:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936669.589284:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.589290:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f59d1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936669.611853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.612279:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503089024 00000100:00100000:3.0:1784936669.612290:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503089024 00000100:00100000:3.0:1784936669.612370:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1784936669.612382:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+6:9694:x1871641503089024:12345-192.168.204.1@tcp:101:chmod.0 00010000:00010000:3.0:1784936669.612409:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936669.612482:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f59d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cae expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.612582:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f59df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.612597:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f59df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.612608:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f59df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936669.612669:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784936669.612683:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936669.613828:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f59df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.613877:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f59d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cae expref: 8 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.613900:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f59df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cae expref: 7 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.613909:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d173a300) 00010000:00010000:2.0:1784936669.613934:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784936669.613938:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5600, rc 0) 00000100:00100000:2.0:1784936669.614006:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+7:9694:x1871641503089024:12345-192.168.204.1@tcp:101:chmod.0 Request processed in 1626us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936669.614015:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:2.0:1784936669.623907:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.624147:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503089280 00000100:00100000:1.0:1784936669.624161:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503089280 00000100:00100000:1.0:1784936669.624228:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:1.0:1784936669.624239:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+7:9694:x1871641503089280:12345-192.168.204.1@tcp:36:chmod.0 00010000:00010000:1.0:1784936669.624296:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936669.624327:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f59df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cae expref: 7 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.624346:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d173a300) 00010000:00010000:1.0:1784936669.624367:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936669.624396:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.624410:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.624466:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936669.625070:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ce6da98 reply state 0000000029445cc1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936669.625081:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784936669.625096:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784936669.625263:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+8:9694:x1871641503089280:12345-192.168.204.1@tcp:36:chmod.0 Request processed in 1025us (1367us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784936669.625273:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00010000:00010000:1.0:1784936669.635497:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.635516:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.635524:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.635531:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.635536:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.635554:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.635572:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246700) 00010000:00010000:1.0:1784936669.635575:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784936669.635581:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.635602:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59e6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936669.668489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.668617:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503089408 00000100:00100000:1.0:1784936669.668627:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503089408 00000100:00100000:1.0:1784936669.668699:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1784936669.668709:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+7:9695:x1871641503089408:12345-192.168.204.1@tcp:101:chown.0 00010000:00010000:1.0:1784936669.668735:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936669.668759:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cb5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.668828:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fcc00/0x6cf7a864723f59f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.668853:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fcc00/0x6cf7a864723f59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.668867:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fcc00/0x6cf7a864723f59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936669.668939:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784936669.668943:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936669.668984:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fcc00/0x6cf7a864723f59f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.669010:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f59ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cb5 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.669027:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fcc00/0x6cf7a864723f59f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cb5 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.669049:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246700) 00010000:00010000:1.0:1784936669.669052:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936669.669055:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fcc00, rc 0) 00000100:00100000:1.0:1784936669.669105:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+8:9695:x1871641503089408:12345-192.168.204.1@tcp:101:chown.0 Request processed in 398us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936669.669112:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1784936669.677850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.678087:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503089536 00000100:00100000:1.0:1784936669.678100:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503089536 00000100:00100000:1.0:1784936669.678162:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:1.0:1784936669.678173:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+8:9695:x1871641503089536:12345-192.168.204.1@tcp:101:chown.0 00010000:00010000:1.0:1784936669.678195:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936669.678217:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f59fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cbc expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678305:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678319:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678340:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678356:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678363:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678388:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678840:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fca00/0x6cf7a864723f5a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678850:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fca00/0x6cf7a864723f5a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678859:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fca00/0x6cf7a864723f5a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936669.678902:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784936669.678907:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936669.678932:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fca00/0x6cf7a864723f5a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678946:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678953:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678960:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678966:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fc600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.678970:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.678978:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679000:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246700) 00010000:00010000:1.0:1784936669.679003:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936669.679009:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679016:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5a02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679031:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679038:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679044:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679049:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.679052:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679058:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679066:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9096c7246e00) 00010000:00010000:1.0:1784936669.679068:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936669.679071:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679077:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5a09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679124:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f59fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cbc expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679140:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fca00/0x6cf7a864723f5a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cbc expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.679148:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c7246300) 00010000:00010000:1.0:1784936669.679150:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936669.679154:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fca00, rc 0) 00000100:00100000:1.0:1784936669.679230:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+9:9695:x1871641503089536:12345-192.168.204.1@tcp:101:chown.0 Request processed in 1058us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936669.679238:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1784936669.688307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.688863:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503089792 00000100:00100000:1.0:1784936669.688874:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503089792 00000100:00100000:1.0:1784936669.688939:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1784936669.689025:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+9:9695:x1871641503089792:12345-192.168.204.1@tcp:36:chown.0 00010000:00010000:0.0:1784936669.689081:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936669.689118:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fca00/0x6cf7a864723f5a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cbc expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.689139:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c7246300) 00010000:00010000:0.0:1784936669.689151:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936669.689179:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.689193:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.689205:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784936669.753817:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1784936669.754020:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbeef684 reply state 0000000085dd637d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936669.754034:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784936669.754232:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1784936669.754381:0:5796:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784936669.754404:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+7:9695:x1871641503089792:12345-192.168.204.1@tcp:36:chown.0 Request processed in 65453us (66102us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784936669.754412:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00010000:00010000:1.0:1784936669.754534:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.754552:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.754560:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.754566:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.754571:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.754579:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.754604:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38ba000) 00010000:00010000:1.0:1784936669.754619:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784936669.754624:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.754630:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936669.776463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936669.777086:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503089920 00000100:00100000:2.0:1784936669.777096:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503089920 00000100:00100000:2.0:1784936669.777152:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:2.0:1784936669.777161:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:9696:x1871641503089920:12345-192.168.204.1@tcp:101:touch.500 00010000:00010000:2.0:1784936669.777184:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936669.777204:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5a1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cc3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936669.782788:0:5798:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5536us 00010000:00010000:0.0:1784936669.803781:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.803807:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.803820:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.803861:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.803870:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.803877:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.804591:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.804603:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807192:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936669.807390:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784936669.807395:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936669.807511:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807527:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807533:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807551:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807569:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936669.807573:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807581:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807596:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246700) 00010000:00010000:0.0:1784936669.807599:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936669.807604:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807610:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807623:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807628:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807634:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807639:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936669.807642:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807647:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807663:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9096c38ba600) 00010000:00010000:0.0:1784936669.807666:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936669.807791:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807799:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.807988:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5a1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cc3 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.808007:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cc3 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.808015:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:0.0:1784936669.808018:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784936669.808020:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a600, rc 0) 00000100:00100000:0.0:1784936669.808100:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+7:9696:x1871641503089920:12345-192.168.204.1@tcp:101:touch.500 Request processed in 30938us (31677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936669.808108:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:2.0:1784936669.817775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.818150:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503090176 00000100:00100000:3.0:1784936669.818163:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503090176 00000100:00100000:3.0:1784936669.818233:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:3.0:1784936669.818243:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+7:9696:x1871641503090176:12345-192.168.204.1@tcp:101:touch.500 00010000:00010000:3.0:1784936669.818265:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936669.818290:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5a3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cca expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.818790:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.818808:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.818820:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.818903:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.819081:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.819092:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936669.822697:0:6621:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784936669.827337:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827362:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827375:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827572:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827580:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827587:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827594:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936669.827598:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827763:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827780:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:0.0:1784936669.827783:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936669.827788:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.827794:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5a41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936669.827808:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000460f7ef7 reply state 00000000922cb759 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936669.827818:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784936669.827987:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5a3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cca expref: 10 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.828018:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cca expref: 9 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.828026:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096c38ba600) 00010000:00010000:0.0:1784936669.828028:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936669.828031:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b200, rc 0) 00000100:00100000:0.0:1784936669.828197:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+10:9696:x1871641503090176:12345-192.168.204.1@tcp:101:touch.500 Request processed in 9952us (10430us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784936669.828206:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:2.0:1784936669.832713:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.833262:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503090432 00000100:00100000:3.0:1784936669.833273:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503090432 00000100:00100000:3.0:1784936669.833337:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1784936669.833348:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+10:9696:x1871641503090432:12345-192.168.204.1@tcp:36:touch.500 00010000:00010000:3.0:1784936669.833408:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936669.833461:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b200/0x6cf7a864723f5a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cca expref: 10 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.833480:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096c38ba600) 00010000:00010000:3.0:1784936669.833492:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936669.833535:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.833559:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.833568:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936669.833749:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be6bac92 reply state 00000000f6092a0c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936669.833759:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784936669.833864:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+11:9696:x1871641503090432:12345-192.168.204.1@tcp:36:touch.500 Request processed in 517us (1160us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784936669.833872:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1784936669.836921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936669.837110:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503090560 00000100:00100000:0.0:1784936669.837122:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503090560 00000100:00100000:0.0:1784936669.837178:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:0.0:1784936669.837187:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+11:9696:x1871641503090560:12345-192.168.204.1@tcp:101:touch.500 00010000:00010000:0.0:1784936669.837213:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936669.837233:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cd1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.837288:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cd1 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.837303:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cd1 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.837323:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096d173ad00) 00010000:00010000:0.0:1784936669.837326:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936669.837345:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a000, rc 0) 00000100:00100000:0.0:1784936669.837401:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+12:9696:x1871641503090560:12345-192.168.204.1@tcp:101:touch.500 Request processed in 214us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936669.837408:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00010000:00010000:3.0:1784936669.840625:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.840641:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.840648:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.840653:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936669.840658:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.840663:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.840680:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096d173ad00) 00010000:00010000:3.0:1784936669.840684:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936669.840688:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.840694:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936669.842078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936669.842217:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503090688 00000100:00100000:0.0:1784936669.842226:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503090688 00000100:00100000:0.0:1784936669.842277:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1784936669.842284:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1871641503090688:12345-192.168.204.1@tcp:8:touch.500 00010000:00080000:0.0:1784936669.842317:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:0.0:1784936669.842349:0:6595:0:(genops.c:1406:class_connect()) connect: client 486efceb-7a20-41d5-8389-4305380725bf, cookie 0x6cf7a864723f5a6b 00002000:00100000:0.0:1784936669.842363:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 486efceb-7a20-41d5-8389-4305380725bf/ffff9096ffa3f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784936669.842374:0:6595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784936669.842647:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784936669.842681:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9096ffa3b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936669.842743:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2370:x1871641503090688:12345-192.168.204.1@tcp:8:touch.500 Request processed in 457us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936669.842752:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00010000:00010000:1.0:1784936669.843207:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.843218:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.843224:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.843229:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.843233:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.843239:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.843255:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9096d173ae00) 00010000:00010000:1.0:1784936669.843257:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936669.843262:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.843267:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5a48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936669.845754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.845887:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503090816 00000100:00100000:1.0:1784936669.845897:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503090816 00000100:00100000:1.0:1784936669.845970:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:1.0:1784936669.845980:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:0:x1871641503090816:12345-192.168.204.1@tcp:2:touch.500 00000100:00080000:3.0:1784936669.846367:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1784936669.891970:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000100:00100000:1.0:1784936669.892263:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:0:x1871641503090816:12345-192.168.204.1@tcp:2:touch.500 Request processed in 46277us (46509us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784936669.892275:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000001:00080000:0.0:1784936669.894521:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1784936669.895512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936669.895618:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503091072 00000100:00100000:2.0:1784936669.895629:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503091072 00000100:00100000:2.0:1784936669.895734:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1784936669.895745:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+10:9696:x1871641503091072:12345-192.168.204.1@tcp:35:touch.500 00000100:00100000:2.0:1784936669.896125:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+11:9696:x1871641503091072:12345-192.168.204.1@tcp:35:touch.500 Request processed in 380us (617us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784936669.896151:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1784936669.913644:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.914080:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503091200 00000100:00100000:3.0:1784936669.914090:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503091200 00000100:00100000:3.0:1784936669.914191:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:3.0:1784936669.914203:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+11:9697:x1871641503091200:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:3.0:1784936669.914230:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936669.914252:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cd8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.914321:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.914335:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.914347:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936669.914406:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784936669.914410:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936669.914487:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.914514:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5a72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cd8 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.914533:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cd8 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.914571:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:3.0:1784936669.914575:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936669.914579:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4600, rc 0) 00000100:00100000:3.0:1784936669.914638:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+12:9697:x1871641503091200:12345-192.168.204.1@tcp:101:rm.0 Request processed in 437us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936669.914644:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:2.0:1784936669.917884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.918123:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503091456 00000100:00100000:3.0:1784936669.918134:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503091456 00000100:00100000:3.0:1784936669.918191:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:3.0:1784936669.918200:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+12:9697:x1871641503091456:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:3.0:1784936669.918220:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936669.918239:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5a80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cdf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936669.918352:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784936669.918559:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5a80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cdf expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.918572:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246700) 00010000:00010000:3.0:1784936669.918576:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784936669.918581:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5a80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cdf expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.918594:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4c00, rc 0) 00000100:00100000:3.0:1784936669.918643:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+13:9697:x1871641503091456:12345-192.168.204.1@tcp:101:rm.0 Request processed in 444us (768us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1784936669.918658:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:0.0:1784936669.923785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.923878:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503091584 00000100:00100000:1.0:1784936669.923888:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503091584 00000100:00100000:1.0:1784936669.923964:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:1.0:1784936669.923975:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+13:9697:x1871641503091584:12345-192.168.204.1@tcp:37:rm.0 00000100:00100000:1.0:1784936669.939724:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+13:9697:x1871641503091584:12345-192.168.204.1@tcp:37:rm.0 Request processed in 15742us (16065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936669.939738:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:2.0:1784936669.945170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.945278:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503091840 00000100:00100000:1.0:1784936669.945288:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503091840 00000100:00100000:1.0:1784936669.945347:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:1.0:1784936669.945357:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8815c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+13:9697:x1871641503091840:12345-192.168.204.1@tcp:35:rm.0 00000100:00100000:1.0:1784936669.945733:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8815c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+14:9697:x1871641503091840:12345-192.168.204.1@tcp:35:rm.0 Request processed in 377us (571us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784936669.945741:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1784936669.949222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936669.949310:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503092096 00000100:00100000:2.0:1784936669.949320:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503092096 00000100:00100000:2.0:1784936669.949375:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:2.0:1784936669.949385:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+14:9697:x1871641503092096:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:2.0:1784936669.949410:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936669.949463:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5a8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ce6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.949595:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5a95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.949609:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.949620:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936669.949631:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784936669.949759:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5a8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ce6 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.949779:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ce6 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936669.949806:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:2.0:1784936669.949810:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784936669.949813:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19400, rc 0) 00000100:00100000:2.0:1784936669.950282:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503092096:12345-192.168.204.1@tcp:101:rm.0 Request processed in 896us (1066us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784936669.950291:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:2.0:1784936669.954606:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.954703:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503092224 00000100:00100000:1.0:1784936669.954715:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503092224 00000100:00100000:1.0:1784936669.954780:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:1.0:1784936669.954791:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503092224:12345-192.168.204.1@tcp:41:rm.0 00000004:00000024:1.0:1784936669.954879:0:6621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1784936669.954967:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503092224:12345-192.168.204.1@tcp:41:rm.0 Request processed in 177us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936669.954975:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:0.0:1784936669.957295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.957375:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503092352 00000100:00100000:3.0:1784936669.957384:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503092352 00000100:00100000:3.0:1784936669.957464:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:3.0:1784936669.957474:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503092352:12345-192.168.204.1@tcp:101:rm.0 00010000:00010000:3.0:1784936669.957494:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936669.957514:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ced expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957587:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957602:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957614:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957628:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957635:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957641:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957753:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957775:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957783:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936669.957811:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784936669.957815:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936669.957847:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957859:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957867:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957873:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957878:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957884:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936669.957888:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957895:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957907:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:3.0:1784936669.957922:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936669.957935:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957941:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957954:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957960:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957965:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957970:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936669.957973:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957978:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957987:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9096d173aa00) 00010000:00010000:3.0:1784936669.957989:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936669.957991:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.957996:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.958035:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ced expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.958060:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ced expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.958068:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096d173ad00) 00010000:00010000:3.0:1784936669.958070:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936669.958072:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5c00, rc 0) 00000100:00100000:3.0:1784936669.958133:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+17:9697:x1871641503092352:12345-192.168.204.1@tcp:101:rm.0 Request processed in 661us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936669.958139:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:0.0:1784936669.961786:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.964328:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503092608 00000100:00100000:1.0:1784936669.964345:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503092608 00000100:00100000:1.0:1784936669.964463:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:1.0:1784936669.964474:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+17:9697:x1871641503092608:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:1.0:1784936669.964533:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784936669.964573:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ced expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964605:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5a64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cd1 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964619:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096d173ad00) 00010000:00010000:1.0:1784936669.964650:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cd8 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964670:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:1.0:1784936669.964675:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936669.964700:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964713:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964723:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964755:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964762:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.964770:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.965102:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.965112:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.965119:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784936669.966267:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1784936669.966280:0:6621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335717850731ns, next at 336717847726ns, rc = 0 00010000:00010000:1.0:1784936669.966345:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966358:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966368:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966376:0:6621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966394:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966401:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966640:0:6621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936669.966688:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966694:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966701:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966707:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fc600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.966711:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966719:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966730:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096c7246e00) 00010000:00010000:1.0:1784936669.966733:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784936669.966737:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966743:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5acd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966759:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966772:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966778:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966782:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fdc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.966785:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966791:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966799:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:1.0:1784936669.966802:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936669.966805:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.966810:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5abf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936669.966820:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba9bba03 reply state 000000003ce8389e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936669.966841:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784936669.967489:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503092608:12345-192.168.204.1@tcp:36:rm.0 Request processed in 3011us (5706us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784936669.967498:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00010000:00010000:3.0:1784936669.971960:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.971977:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.971985:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.971992:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936669.971996:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.972003:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.972021:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9096c7246b00) 00010000:00010000:3.0:1784936669.972025:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936669.972029:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.972050:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5ac6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.974496:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936669.974510:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.974532:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936669.974545:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.974556:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.974575:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9096c7246e00) 00010000:00010000:0.0:1784936669.974578:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784936669.974583:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.974588:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd600/0x6cf7a864723f5ad4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936669.974614:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936669.974616:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936669.974618:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936669.979329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936669.979421:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503092864 00000100:00100000:1.0:1784936669.979476:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503092864 00000100:00100000:1.0:1784936669.979568:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:1.0:1784936669.979582:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+15:9697:x1871641503092864:12345-192.168.204.1@tcp:35:rm.0 00000100:00100000:1.0:1784936669.979861:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503092864:12345-192.168.204.1@tcp:35:rm.0 Request processed in 281us (551us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784936669.979869:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:2.0:1784936669.985370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936669.985424:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093120 00000100:00100000:3.0:1784936669.985480:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093120 00000100:00100000:3.0:1784936669.985554:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1784936669.985566:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+16:9697:x1871641503093120:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:3.0:1784936669.985641:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784936669.985682:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5a95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ce6 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985702:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cc3 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985713:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096c38bad00) 00010000:00010000:3.0:1784936669.985729:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fcc00/0x6cf7a864723f59f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cb5 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985738:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246700) 00010000:00010000:3.0:1784936669.985744:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936669.985767:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985779:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985789:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985820:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985827:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.985833:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.986144:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.986153:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936669.986162:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936669.992990:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784936669.993015:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993025:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993033:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993038:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.993043:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993051:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993066:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9096d173a200) 00010000:00010000:1.0:1784936669.993069:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784936669.993074:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993079:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ae9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993121:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993137:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993143:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993148:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936669.993150:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993157:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993166:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d173aa00) 00010000:00010000:1.0:1784936669.993168:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936669.993171:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936669.993177:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5adb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936669.993191:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000324c5a48 reply state 000000004978e7f1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936669.993200:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784936669.993387:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:9697:x1871641503093120:12345-192.168.204.1@tcp:36:rm.0 Request processed in 7819us (8025us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784936669.993396:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00010000:00010000:3.0:1784936670.002455:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936670.002475:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936670.002485:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936670.002491:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936670.002496:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936670.002523:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936670.002551:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9096d173af00) 00010000:00010000:3.0:1784936670.002554:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936670.002560:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936670.002566:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5ae2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936670.537192:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936670.600833:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524095872:0@lo:400:kworker.0 00000100:00100000:3.0:1784936670.600917:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936670.600983:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784936670.600990:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524095744:0@lo:400:kworker.0 00000100:00100000:3.0:1784936670.601018:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936670.601052:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095872 00000100:00100000:3.0:1784936670.601059:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095872 00000100:00100000:3.0:1784936670.601111:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784936670.601119:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524095872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936670.601175:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524095872:12345-0@lo:400:kworker.0 Request processed in 55us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936670.601181:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784936670.601209:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095744 00000100:00100000:3.0:1784936670.601212:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095744 00000100:00100000:3.0:1784936670.601244:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784936670.601251:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524095744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936670.601297:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524095744:12345-0@lo:400:kworker.0 Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936670.601303:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1784936670.601319:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936670.601349:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524095744:0@lo:400:kworker.0 00010000:00080000:3.0:1784936670.601363:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf5a680 x1871641524095872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936670.601373:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524095872:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.601603:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524095616:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.601635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936670.601662:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524096128:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.601684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936670.601711:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784936670.601718:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524095488:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.601744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936670.601764:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524096000:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.601785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936670.601818:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096128 00000100:00100000:0.0:1784936670.601823:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096128 00000100:00100000:0.0:1784936670.601856:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784936670.601863:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524096128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.602003:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524096128:12345-0@lo:400:kworker.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936670.602010:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1784936670.602042:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf5b100 x1871641524096128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936670.602051:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524096128:0@lo:400:kworker.0 00000100:00100000:1.0:1784936670.602562:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095488 00000100:00100000:1.0:1784936670.602568:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095488 00000100:00100000:1.0:1784936670.602610:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784936670.602617:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524095488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936670.602678:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524095488:12345-0@lo:400:kworker.0 Request processed in 61us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936670.602685:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784936670.602715:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524095616 00000100:00100000:1.0:1784936670.602718:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524095616 00000100:00100000:1.0:1784936670.602739:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096000 00000100:00100000:1.0:1784936670.602741:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096000 00000100:00100000:1.0:1784936670.602758:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784936670.602763:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524095616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936670.602806:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524095616:12345-0@lo:400:kworker.0 Request processed in 42us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936670.602824:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784936670.602836:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784936670.602843:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524096000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936670.602870:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524096000:12345-0@lo:400:kworker.0 Request processed in 28us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936670.602876:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1784936670.603555:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784936670.603562:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936670.604349:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524095488:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.604367:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524096000:0@lo:400:kworker.0 00000100:00100000:0.0:1784936670.604379:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524095616:0@lo:400:kworker.0 00000100:00100000:3.0:1784936670.604465:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524096256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936670.604514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936670.604622:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096256 00000100:00100000:2.0:1784936670.604629:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096256 00000100:00100000:2.0:1784936670.604687:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784936670.604697:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524096256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784936670.604730:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936670.605332:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524096256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 636us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936670.605341:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1784936670.618781:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ff394000 x1871641524096256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936670.618822:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524096256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936671.159039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936671.159077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936671.159120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936671.159152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936671.159180:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093376 00000100:00100000:2.0:1784936671.159189:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093376 00000100:00100000:2.0:1784936671.159250:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093632 00000100:00100000:2.0:1784936671.159254:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093632 00000100:00100000:3.0:1784936671.159266:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:3.0:1784936671.159281:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+14:2373:x1871641503093376:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936671.159366:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+14:2373:x1871641503093376:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936671.160842:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:2.0:1784936671.160863:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:2.0:1784936671.160878:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503093632:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936671.161321:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503093632:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 447us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936671.161329:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:2.0:1784936671.161360:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093248 00000100:00100000:2.0:1784936671.161367:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093248 00000100:00100000:2.0:1784936671.161400:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 247 00000100:00100000:2.0:1784936671.161408:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503093248:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936671.161460:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503093248:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 52us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936671.161467:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 247 00000100:00100000:2.0:1784936671.161501:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093504 00000100:00100000:2.0:1784936671.161504:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093504 00000100:00100000:2.0:1784936671.161555:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1784936671.161563:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503093504:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936671.161597:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503093504:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 35us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936671.161603:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00080000:2.0:1784936671.161621:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936671.161626:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784936671.562893:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936672.599774:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936673.610666:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936674.191615:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936674.191657:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524096384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936674.191755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784936674.191920:0:7045:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339943489649ns, next at 340943487084ns, rc = 0 00000100:00100000:0.0:1784936674.192895:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096384 00000100:00100000:0.0:1784936674.192909:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096384 00000100:00100000:0.0:1784936674.192998:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1784936674.193340:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936674.193646:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524096384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936674.193701:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936674.193979:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524096384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 339us (2222us total) trans 0 rc 0/0 00010000:00080000:3.0:1784936674.194014:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4a9c000 x1871641524096384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936674.194038:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524096384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936674.194263:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000001:02000400:3.0:1784936674.630183:0:11481:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1784936674.632563:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784936674.794638:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1784936674.794674:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:0.0:1784936674.794689:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1784936674.795046:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524096512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784936674.795138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936674.795884:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096512 00000100:00100000:1.0:1784936674.795894:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096512 00000100:00100000:1.0:1784936674.795941:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784936674.795949:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524096512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784936674.795995:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1784936674.796030:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a63f8dd, atime: 0x6a63f8dd, ctime: 0x6a63f8dd, blocks: 0x1 00010000:00010000:1.0:1784936674.796053:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936674.796068:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1784936674.796073:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936674.796079:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936674.796098:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936674.796107:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936674.796115:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936674.796133:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936674.801413:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936674.801458:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936674.801472:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fca00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936674.801478:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936674.801490:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936674.801516:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936674.801524:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000438b4580/0x6cf7a864723f5af0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936674.801545:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936674.801547:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936674.801549:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936674.802007:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1871641524096512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6053us (6864us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784936674.802017:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1784936674.802529:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9095c1eaf800/2, rc 0, transno 4294967300 00000100:00100000:0.0:1784936674.802537:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524096512:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1784936675.281238:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1784936675.656527:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936675.721051:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524096640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936675.721143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936675.721980:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096640 00000100:00100000:3.0:1784936675.721989:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096640 00000100:00100000:3.0:1784936675.722043:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784936675.722052:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524096640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936675.722086:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936675.722246:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524096896:0@lo:400:kworker.0 00000100:00100000:1.0:1784936675.722355:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936675.722384:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784936675.722390:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524096768:0@lo:400:kworker.0 00000100:00100000:1.0:1784936675.722417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936675.722512:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524097280:0@lo:400:kworker.0 00000100:00100000:1.0:1784936675.722537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936675.722604:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524096640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 553us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936675.722627:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1784936675.722649:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936675.722974:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524097024:0@lo:400:kworker.0 00000100:00100000:0.0:1784936675.723007:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524097152:0@lo:400:kworker.0 00000100:00100000:0.0:1784936675.723032:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784936675.723070:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ec899880 x1871641524096640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936675.723090:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524096640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936675.723370:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097152 00000100:00100000:2.0:1784936675.723376:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097152 00000100:00100000:2.0:1784936675.723421:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784936675.723462:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524097152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936675.723513:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524097152:12345-0@lo:400:kworker.0 Request processed in 54us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936675.723520:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784936675.723549:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1784936675.723554:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9095c1eaf800, transno 4294967300 00000100:00100000:2.0:1784936675.723565:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524097152:0@lo:400:kworker.0 00000100:00100000:1.0:1784936675.728484:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096768 00000100:00100000:1.0:1784936675.728501:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096768 00000100:00100000:1.0:1784936675.728559:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784936675.728571:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524096768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936675.729012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936675.729082:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524096768:12345-0@lo:400:kworker.0 Request processed in 513us (6663us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936675.729090:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784936675.729220:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524096768:0@lo:400:kworker.0 00000100:00100000:3.0:1784936675.729854:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524096896 00000100:00100000:3.0:1784936675.729862:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524096896 00000100:00100000:3.0:1784936675.729904:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097280 00000100:00100000:3.0:1784936675.729908:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097280 00000100:00100000:3.0:1784936675.729932:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097024 00000100:00100000:3.0:1784936675.729935:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097024 00000100:00100000:3.0:1784936675.729949:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784936675.729957:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524096896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936675.730012:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524096896:12345-0@lo:400:kworker.0 Request processed in 57us (7658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936675.730018:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784936675.730030:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784936675.730036:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524097280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936675.730063:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524097280:12345-0@lo:400:kworker.0 Request processed in 28us (7525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936675.730068:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784936675.730079:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784936675.730099:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524097024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936675.730263:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524097024:12345-0@lo:400:kworker.0 Request processed in 165us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936675.730269:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784936675.730462:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524097024:0@lo:400:kworker.0 00000100:00080000:3.0:1784936675.730528:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936675.730555:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524097280:0@lo:400:kworker.0 00000100:00100000:3.0:1784936675.730567:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524096896:0@lo:400:kworker.0 00000020:00000080:3.0:1784936675.911381:0:11532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4585d1b0 20000000:00000080:3.0:1784936675.911401:0:11532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9096d46a9400 uarg=0000000000000000 20000000:01000000:3.0:1784936675.911596:0:11532:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1784936675.911604:0:11532:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1784936675.911810:0:11532:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1784936675.916001:0:11533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1784936675.916275:0:11532:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1784936675.922748:0:11532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1784936675.922886:0:11532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1784936675.922952:0:11532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1784936675.923043:0:11532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784936675.923064:0:11532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923085:0:11532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923094:0:11532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923102:0:11532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923122:0:11532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923129:0:11532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923136:0:11532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923175:0:11532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.923193:0:11532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 18 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936675.923208:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097408:0@lo:104: 00000100:00100000:3.0:1784936675.923289:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936675.923820:0:5780:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097408 00000100:00100000:1.0:1784936675.923829:0:5780:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097408 00000100:00100000:1.0:1784936675.923888:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784936675.923899:0:5780:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:11532:x1871641524097408:12345-0@lo:104: 00010000:00010000:1.0:1784936675.923915:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936675.923985:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784936675.923991:0:5780:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b62e4f62-8046-4b06-8586-527734139351+3:11532:x1871641524097408:12345-0@lo:104: Request processed in 94us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936675.923998:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1784936675.924089:0:11532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.924100:0:11532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 18 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924109:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784936675.924112:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097536:0@lo:104: 00010000:00010000:2.0:1784936675.924117:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924126:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936675.924131:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924139:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936675.924143:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1784936675.924152:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936675.924158:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784936675.924183:0:11532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936675.924193:0:11532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 18 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924199:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924217:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784936675.924225:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097664:0@lo:104: 00010000:00010000:2.0:1784936675.924243:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936675.924255:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784936675.924264:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f59bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59c3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924278:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936675.924282:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936675.924284:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936675.924300:0:11532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.924300:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524097792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784936675.924321:0:11532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 12 pid: 5788 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.924338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936675.924378:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097792 00000100:00100000:2.0:1784936675.924382:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097792 00010000:00010000:2.0:1784936675.924401:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 19 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.924451:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784936675.924460:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524097792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936675.924470:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936675.924477:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 19 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924487:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 19 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924504:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936675.924530:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524097792:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936675.924537:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784936675.924579:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524097792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784936675.924664:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784936675.924676:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097536 00000100:00100000:0.0:1784936675.924680:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097536 00000100:00100000:0.0:1784936675.924696:0:5779:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524097664 00000100:00100000:0.0:1784936675.924698:0:5779:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524097664 00000100:00100000:0.0:1784936675.924707:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784936675.924713:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:11532:x1871641524097536:12345-0@lo:104: 00010000:00010000:0.0:1784936675.924732:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936675.924773:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936675.924778:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+4:11532:x1871641524097536:12345-0@lo:104: Request processed in 66us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936675.924784:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784936675.924795:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784936675.924800:0:5779:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:11532:x1871641524097664:12345-0@lo:104: 00010000:00010000:0.0:1784936675.924815:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936675.924841:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784936675.924846:0:5779:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff4f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b62e4f62-8046-4b06-8586-527734139351+3:11532:x1871641524097664:12345-0@lo:104: Request processed in 46us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936675.924851:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1784936675.924970:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784936675.924975:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924983:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936675.924986:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.924993:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936675.924999:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936675.925004:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784936675.925021:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925026:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936675.925042:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925049:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f59ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59b5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925059:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936675.925061:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925067:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd400 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936675.925075:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925082:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936675.925088:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936675.925094:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784936675.925104:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925109:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936675.925115:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925121:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fd400/0x6cf7a864723f59a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f59a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925132:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936675.925134:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936675.925135:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936675.925145:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524098048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936675.925168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936675.925193:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784936675.925198:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524098176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936675.925221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936675.925245:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098048 00000100:00100000:2.0:1784936675.925248:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098048 00010000:00010000:2.0:1784936675.925267:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 19 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.925287:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098176 00000100:00100000:3.0:1784936675.925289:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097920:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936675.925291:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098176 00010000:00010000:2.0:1784936675.925304:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 20 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.925318:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784936675.925325:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+20:3305:x1871641524098048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936675.925334:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936675.925339:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 20 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925349:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 20 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925358:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936675.925382:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+20:3305:x1871641524098048:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936675.925388:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784936675.925400:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784936675.925405:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524098176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936675.925412:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936675.925416:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 19 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925455:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 19 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.925475:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936675.925498:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524098176:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936675.925504:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784936675.925568:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524098176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936675.925577:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524098048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936675.925593:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936675.927908:0:11532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936675.927926:0:11532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936675.927941:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec898700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524098304:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936675.928002:0:11532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c93726c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784936675.928027:0:11532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4200/0x6cf7a864723f59c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f59bc expref: 18 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936675.928040:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097408:0@lo:104: 00010000:00010000:0.0:1784936675.928051:0:11532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d19200/0x6cf7a864723f59b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f59ae expref: 17 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936675.928058:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097536:0@lo:104: 00010000:00010000:0.0:1784936675.928067:0:11532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f59a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f59a0 expref: 16 pid: 5791 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936675.928075:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097664:0@lo:104: 00000100:00100000:3.0:1784936675.930698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936675.930862:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524097920:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936675.930953:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093760 00000100:00100000:2.0:1784936675.930961:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093760 00010000:00010000:2.0:1784936675.930998:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 13 pid: 5788 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.931047:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:2.0:1784936675.931057:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503093760:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936675.931073:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936675.931078:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 13 pid: 5788 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.931092:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 13 pid: 5788 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.931109:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f5999 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca7 expref: 13 pid: 5788 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.931124:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936675.931185:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:2372:x1871641503093760:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 128us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936675.931198:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:3.0:1784936675.934780:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec898700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11532:1871641524098304:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936675.934834:0:11532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936675.939399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936675.939515:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503093888 00000100:00100000:2.0:1784936675.939526:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503093888 00010000:00010000:2.0:1784936675.939567:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936675.939607:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1784936675.939616:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:2371:x1871641503093888:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936675.939633:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936675.939640:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939655:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939671:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f5992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ca0 expref: 12 pid: 5791 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939689:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939699:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939726:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939734:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939760:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939768:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939774:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936675.939779:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939788:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939813:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936675.939826:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936675.939898:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2371:x1871641503093888:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 282us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936675.939905:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00010000:00010000:0.0:1784936675.940074:0:11532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936675.940083:0:11532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936675.940089:0:11532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5600/0x6cf7a864723f5af7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936676.279085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936676.279134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936676.279179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936676.279270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936676.279291:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094016 00000100:00100000:2.0:1784936676.279308:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094016 00000100:00100000:1.0:1784936676.279340:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094272 00000100:00100000:1.0:1784936676.279350:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094272 00000100:00100000:2.0:1784936676.279385:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 249 00000100:00100000:2.0:1784936676.279406:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2374:x1871641503094016:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936676.279484:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:1.0:1784936676.279499:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503094272:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936676.279548:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2374:x1871641503094016:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 150us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936676.279557:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 249 00000100:00100000:1.0:1784936676.279570:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503094272:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936676.279599:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00080000:2.0:1784936676.279624:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784936676.280262:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094144 00000100:00100000:3.0:1784936676.280271:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094144 00000100:00100000:3.0:1784936676.280459:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094400 00000100:00100000:3.0:1784936676.280464:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094400 00000100:00080000:0.0:1784936676.280527:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936676.280536:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:1.0:1784936676.280547:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503094144:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936676.280606:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503094144:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 61us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936676.280614:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:3.0:1784936676.280739:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:3.0:1784936676.280747:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503094400:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936676.280778:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503094400:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 32us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936676.280784:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 102 00010000:00010000:2.0:1784936676.681063:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936677.367140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936677.367241:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094528 00000100:00100000:1.0:1784936677.367251:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094528 00000100:00100000:1.0:1784936677.367308:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 250 00000100:00100000:1.0:1784936677.367677:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:5591:x1871641503094528:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936677.367696:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936677.367717:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c13fcc00/0x6cf7a864723f5afe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cf4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.367746:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fcc00/0x6cf7a864723f5afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cf4 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.367758:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c13fcc00/0x6cf7a864723f5afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cf4 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.367767:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fcc00, rc 0) 00000100:00100000:1.0:1784936677.367882:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503094528:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 564us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.367890:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 250 00000100:00100000:1.0:1784936677.382414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936677.382817:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094656 00000100:00100000:2.0:1784936677.382827:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094656 00000100:00100000:2.0:1784936677.382880:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 251 00000100:00100000:2.0:1784936677.382890:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503094656:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936677.383165:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503094656:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 275us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936677.383174:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 251 00000100:00100000:3.0:1784936677.387874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936677.388231:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094784 00000100:00100000:2.0:1784936677.388240:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094784 00000100:00100000:2.0:1784936677.388293:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 252 00000100:00100000:2.0:1784936677.388301:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503094784:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784936677.389017:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503094784:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 714us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936677.389025:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 252 00000100:00100000:3.0:1784936677.401920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936677.402317:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503094912 00000100:00100000:1.0:1784936677.402333:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503094912 00000100:00100000:1.0:1784936677.402386:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 253 00000100:00100000:1.0:1784936677.402409:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:9967:x1871641503094912:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784936677.408718:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:9967:x1871641503094912:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 6300us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.408734:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 253 00000100:00100000:1.0:1784936677.419530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936677.426922:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095040 00000100:00100000:2.0:1784936677.426938:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095040 00000100:00100000:2.0:1784936677.427020:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 254 00000100:00100000:2.0:1784936677.427031:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:9967:x1871641503095040:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784936677.427293:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:9967:x1871641503095040:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 264us (7774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936677.427301:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 254 00000100:00100000:3.0:1784936677.430019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936677.430838:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095168 00000100:00100000:0.0:1784936677.430848:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095168 00000100:00100000:0.0:1784936677.430901:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 255 00000100:00100000:0.0:1784936677.430910:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:5591:x1871641503095168:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936677.430925:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936677.430941:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26a400/0x6cf7a864723f5b05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94cfb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.430968:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26a400/0x6cf7a864723f5b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cfb expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.430979:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26a400/0x6cf7a864723f5b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cfb expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.431001:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a400, rc 0) 00000100:00100000:0.0:1784936677.431580:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503095168:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 669us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.431588:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 255 00000100:00100000:3.0:1784936677.446568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936677.446759:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095296 00000100:00100000:1.0:1784936677.446769:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095296 00000100:00100000:1.0:1784936677.446832:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 256 00000100:00100000:1.0:1784936677.446843:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503095296:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.447135:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503095296:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 293us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.447144:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 256 00000100:00100000:1.0:1784936677.454521:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936677.455371:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095424 00000100:00100000:0.0:1784936677.455382:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095424 00000100:00100000:0.0:1784936677.455612:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 257 00000100:00100000:0.0:1784936677.455623:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503095424:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.460675:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:5591:x1871641503095424:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 5043us (6153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.460698:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 257 00000100:00100000:3.0:1784936677.469361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936677.469965:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095552 00000100:00100000:2.0:1784936677.469975:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095552 00000100:00100000:2.0:1784936677.470035:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 258 00000100:00100000:2.0:1784936677.470068:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:9970:x1871641503095552:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784936677.470312:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:9970:x1871641503095552:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 246us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936677.470320:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 258 00000100:00100000:3.0:1784936677.476918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936677.477904:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095680 00000100:00100000:0.0:1784936677.477915:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095680 00000100:00100000:0.0:1784936677.477970:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 259 00000100:00100000:0.0:1784936677.477979:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:9970:x1871641503095680:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784936677.478229:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:9970:x1871641503095680:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 250us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.478237:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 259 10000000:01000000:0.0:1784936677.576916:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936677.576925:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ffa3c000 from 7 10000000:01000000:0.0:1784936677.576931:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936677.576982:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.576995:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.577021:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936677.577063:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524098432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.577137:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.577214:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.577345:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098432 00000100:00100000:1.0:1784936677.577353:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098432 00000100:00100000:1.0:1784936677.577413:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784936677.577424:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+16:5793:x1871641524098432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936677.577464:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936677.577477:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c13fca00/0x6cf7a864723f5b13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5b0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.577501:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fca00/0x6cf7a864723f5b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5b0c expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.577512:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c13fca00/0x6cf7a864723f5b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5b0c expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.577522:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fca00, rc 0) 00000100:00100000:1.0:1784936677.577573:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524098432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.577587:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1784936677.577689:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524098432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936677.577705:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936677.577715:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936677.577785:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524098560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784936677.577812:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936677.577840:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4652b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.577941:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098560 00000100:00100000:1.0:1784936677.577946:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098560 00000100:00100000:1.0:1784936677.577975:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784936677.577982:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524098560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.578232:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524098560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.578239:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784936677.578285:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524098560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936677.578334:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524098688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936677.578371:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936677.578411:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c93726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.578721:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098688 00000100:00100000:1.0:1784936677.578725:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098688 00000100:00100000:1.0:1784936677.578745:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784936677.578752:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524098688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.578896:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524098688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.578904:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784936677.580278:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524098688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.581874:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11545:1871641524098816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936677.581936:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936677.581975:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936677.582029:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098816 00000100:00100000:2.0:1784936677.582035:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098816 00000100:00100000:2.0:1784936677.582074:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784936677.582082:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:11545:x1871641524098816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936677.582265:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+17:11545:x1871641524098816:12345-0@lo:502:llog_process_th.0 Request processed in 183us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936677.582273:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784936677.582357:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11545:1871641524098816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784936677.582378:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936677.582386:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936677.582388:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784936677.582409:0:11545:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9096ffa3c000 00000020:00000080:1.0:1784936677.582412:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784936677.582509:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11545:1871641524098944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936677.584687:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.584713:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524098944 00000100:00100000:0.0:1784936677.584720:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524098944 00000100:00100000:1.0:1784936677.584736:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.584758:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784936677.584778:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:11545:x1871641524098944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936677.584986:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:11545:x1871641524098944:12345-0@lo:502:llog_process_th.0 Request processed in 209us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.584995:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784936677.586278:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11545:1871641524098944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784936677.586830:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936677.586839:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936677.586841:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784936677.586845:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784936677.588372:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784936677.588411:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936677.588424:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.588463:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936677.588474:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936677.588477:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096f4d33000 from 7 10000000:01000000:0.0:1784936677.588480:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936677.588516:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.588524:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.588894:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936677.588923:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.588986:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.589034:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.589098:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099072 00000100:00100000:1.0:1784936677.589105:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099072 00000100:00100000:1.0:1784936677.589153:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784936677.589162:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+17:5793:x1871641524099072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936677.589176:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936677.589189:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f5b21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5b1a expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.589211:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f5b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5b1a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.589222:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f5b21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5b1a expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936677.589230:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fd600, rc 0) 00000100:00100000:1.0:1784936677.589270:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524099072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.589276:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784936677.589519:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936677.589534:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.589554:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936677.589602:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.589628:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.589654:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.589748:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099200 00000100:00100000:1.0:1784936677.589753:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099200 00000100:00100000:1.0:1784936677.589783:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784936677.589789:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524099200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.590035:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524099200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.590041:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784936677.590572:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.590605:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.590648:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.590681:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.590790:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099328 00000100:00100000:1.0:1784936677.590794:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099328 00000100:00100000:1.0:1784936677.590827:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784936677.590835:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524099328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.590981:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c9ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524099328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.590988:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784936677.591111:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.592026:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11547:1871641524099456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936677.592070:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.592134:0:11547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c11cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936677.598050:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099456 00000100:00100000:1.0:1784936677.598066:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099456 00000100:00100000:1.0:1784936677.598118:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784936677.598127:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:11547:x1871641524099456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936677.598414:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:11547:x1871641524099456:12345-0@lo:502:llog_process_th.0 Request processed in 287us (6342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936677.598422:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784936677.598483:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11547:1871641524099456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784936677.598520:0:11547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936677.598531:0:11547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936677.598533:0:11547:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784936677.598539:0:11547:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9096f4d33000 00000020:00000080:0.0:1784936677.598541:0:11547:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784936677.598625:0:11547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11547:1871641524099584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936677.598670:0:11547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.598700:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099584 00000100:00100000:0.0:1784936677.598704:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099584 00000100:00100000:0.0:1784936677.598727:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784936677.598734:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:11547:x1871641524099584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936677.599169:0:11547:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c133a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.603283:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+18:11547:x1871641524099584:12345-0@lo:502:llog_process_th.0 Request processed in 4539us (4602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.603295:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784936677.603495:0:11547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11547:1871641524099584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784936677.603531:0:11547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936677.603549:0:11547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936677.603552:0:11547:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784936677.603556:0:11547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784936677.604869:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784936677.604893:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936677.604904:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.604917:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936677.604928:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936677.604931:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096d473e000 from 7 10000000:01000000:0.0:1784936677.604934:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936677.604965:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.604983:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.604994:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936677.605017:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec898700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.605075:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.605112:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04180 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.606583:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099712 00000100:00100000:0.0:1784936677.606595:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099712 00000100:00100000:0.0:1784936677.606654:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784936677.606664:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+18:5793:x1871641524099712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936677.606680:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936677.606695:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f5b2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f5b28 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.606721:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f5b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f5b28 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.606732:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f5b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f5b28 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.606741:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ac00, rc 0) 00000100:00100000:0.0:1784936677.606910:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524099712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.606917:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784936677.607006:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec898700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936677.607022:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936677.607032:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936677.607102:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936677.607133:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936677.607165:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.607263:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099840 00000100:00100000:0.0:1784936677.607268:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099840 00000100:00100000:0.0:1784936677.607298:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784936677.607305:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524099840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.607573:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524099840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.607580:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784936677.607609:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.607638:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.607672:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936677.607686:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04840 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.607697:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524099968 00000100:00100000:0.0:1784936677.607700:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524099968 00000100:00100000:0.0:1784936677.607721:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784936677.607728:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524099968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936677.608013:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:5793:x1871641524099968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.608019:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784936677.608521:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec89a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b62e4f62-8046-4b06-8586-527734139351:5793:1871641524099968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936677.609695:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11549:1871641524100096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936677.609751:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936677.609860:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c82cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.609905:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100096 00000100:00100000:0.0:1784936677.609912:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100096 00000100:00100000:0.0:1784936677.609953:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784936677.609962:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:11549:x1871641524100096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936677.610873:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:11549:x1871641524100096:12345-0@lo:502:llog_process_th.0 Request processed in 910us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.610883:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784936677.620664:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11549:1871641524100096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936677.620717:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936677.620729:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936677.620731:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784936677.620737:0:11549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9096d473e000 00000020:00000080:3.0:1784936677.620740:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784936677.620862:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11549:1871641524100224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936677.620942:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936677.620991:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936677.621189:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100224 00000100:00100000:0.0:1784936677.621202:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100224 00000100:00100000:0.0:1784936677.621250:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784936677.621259:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:11549:x1871641524100224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936677.621518:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:11549:x1871641524100224:12345-0@lo:502:llog_process_th.0 Request processed in 260us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936677.621525:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784936677.622159:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b62e4f62-8046-4b06-8586-527734139351:11549:1871641524100224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936677.622186:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936677.622192:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936677.622194:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784936677.622198:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784936677.622546:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784936677.622576:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936677.622586:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936677.622597:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784936677.626950:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784936677.706123:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784936678.665725:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784936678.730208:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936679.307458:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784936679.307497:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524100352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936679.307569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936679.307879:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100352 00000100:00100000:1.0:1784936679.307887:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100352 00000100:00100000:1.0:1784936679.307957:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784936679.307968:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524100352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936679.308002:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936679.308070:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524100352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936679.308077:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784936679.308278:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524100352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784936679.308517:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784936679.754222:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936680.777515:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936680.840799:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524100608:0@lo:400:kworker.0 00000100:00100000:2.0:1784936680.840864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936680.840919:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524101120:0@lo:400:kworker.0 00000100:00100000:2.0:1784936680.840945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936680.840975:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784936680.840981:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524100736:0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.840982:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524100864:0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936680.841032:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784936680.841038:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524100480:0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936680.841095:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524100992:0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936680.841145:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100608 00000100:00100000:1.0:1784936680.841153:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100608 00000100:00100000:0.0:1784936680.841177:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100480 00000100:00100000:0.0:1784936680.841181:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100480 00000100:00100000:1.0:1784936680.841194:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100992 00000100:00100000:1.0:1784936680.841196:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100992 00000100:00100000:0.0:1784936680.841207:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1784936680.841216:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841222:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784936680.841227:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524100608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841259:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524100608:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936680.841274:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524100480:12345-0@lo:400:kworker.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936680.841282:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784936680.841282:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1784936680.841307:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784936680.841313:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524100992:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784936680.841326:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936680.841353:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524100992:12345-0@lo:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936680.841356:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101120 00000100:00100000:1.0:1784936680.841358:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784936680.841360:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101120 00000100:00100000:0.0:1784936680.841386:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100864 00000100:00100000:0.0:1784936680.841388:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100864 00000100:00100000:1.0:1784936680.841390:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524100480:0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841403:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524100992:0@lo:400:kworker.0 00000100:00100000:0.0:1784936680.841406:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784936680.841411:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524101120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841451:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784936680.841458:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.841496:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524100864:12345-0@lo:400:kworker.0 Request processed in 39us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936680.841501:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1784936680.841515:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936680.841529:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524100864:0@lo:400:kworker.0 00000100:00100000:0.0:1784936680.841616:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524101120:12345-0@lo:400:kworker.0 Request processed in 204us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936680.841623:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784936680.841710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936680.841832:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524100608:0@lo:400:kworker.0 00010000:00080000:2.0:1784936680.841844:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ff397100 x1871641524101120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936680.841854:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524101120:0@lo:400:kworker.0 00000100:00100000:0.0:1784936680.847169:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936680.847192:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936680.847267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936680.847317:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101248 00000100:00100000:0.0:1784936680.847324:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101248 00000100:00100000:0.0:1784936680.847382:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784936680.847392:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524101248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936680.847456:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936680.847501:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524101248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936680.847509:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1784936680.847546:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096edf5b100 x1871641524101248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936680.847566:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936680.851649:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524100736 00000100:00100000:1.0:1784936680.851663:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524100736 00000100:00100000:1.0:1784936680.851736:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784936680.851746:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524100736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936680.851840:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524100736:12345-0@lo:400:kworker.0 Request processed in 96us (10129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936680.851848:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784936680.851919:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524100736:0@lo:400:kworker.0 00000100:00080000:2.0:1784936680.852635:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936681.398258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936681.398327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936681.398373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936681.398415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936681.398472:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095808 00000100:00100000:0.0:1784936681.398489:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095808 00000100:00100000:3.0:1784936681.398498:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096064 00000100:00100000:3.0:1784936681.398508:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096064 00000100:00100000:0.0:1784936681.398579:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 276 00000100:00100000:3.0:1784936681.398596:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1784936681.398599:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503095808:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936681.398612:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503096064:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936681.398730:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503095808:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936681.398740:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 276 00000100:00100000:3.0:1784936681.398772:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503096064:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936681.398782:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1784936681.398806:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503095936 00000100:00100000:0.0:1784936681.398813:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503095936 00000100:00080000:3.0:1784936681.398822:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936681.398830:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936681.398863:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096192 00000100:00100000:0.0:1784936681.398868:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096192 00000100:00100000:3.0:1784936681.398887:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00100000:3.0:1784936681.398901:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503095936:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936681.398930:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:0.0:1784936681.398941:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503096192:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936681.398952:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503095936:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 53us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936681.398961:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00080000:3.0:1784936681.399003:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936681.399004:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503096192:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 51us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936681.399013:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 107 00010000:00010000:2.0:1784936681.800566:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936682.824606:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936683.849290:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936684.424938:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524101376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936684.425012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936684.426464:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101376 00000100:00100000:0.0:1784936684.426477:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101376 00000100:00100000:0.0:1784936684.426579:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784936684.426591:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524101376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936684.426634:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784936684.426742:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936684.432703:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524101376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6104us (7680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936684.432720:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784936684.434927:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524101376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784936684.873574:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936685.896601:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936685.960683:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524101760:0@lo:400:kworker.0 00000100:00100000:2.0:1784936685.960754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936685.960843:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524101632:0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.960874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936685.960892:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524102144:0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.960914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936685.961071:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102144 00000100:00100000:2.0:1784936685.961078:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102144 00000100:00100000:2.0:1784936685.961131:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784936685.961139:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524102144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936685.961188:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524102144:12345-0@lo:400:kworker.0 Request processed in 49us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936685.961194:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784936685.961334:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784936685.961367:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ff397100 x1871641524102144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936685.961424:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524102144:0@lo:400:kworker.0 00000100:00100000:3.0:1784936685.969666:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524101504:0@lo:400:kworker.0 00000100:00100000:3.0:1784936685.969757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936685.969816:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524102016:0@lo:400:kworker.0 00000100:00100000:3.0:1784936685.969846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936685.969908:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101504 00000100:00100000:0.0:1784936685.969918:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101504 00000100:00100000:0.0:1784936685.969968:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784936685.969978:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524101504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.970048:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524101504:12345-0@lo:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936685.970057:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784936685.970155:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101760 00000100:00100000:0.0:1784936685.970159:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101760 00000100:00100000:0.0:1784936685.970193:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101632 00000100:00100000:0.0:1784936685.970196:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101632 00000100:00100000:0.0:1784936685.970207:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102016 00000100:00100000:0.0:1784936685.970210:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102016 00000100:00100000:0.0:1784936685.970310:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784936685.970319:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524101760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.970355:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524101760:12345-0@lo:400:kworker.0 Request processed in 38us (9601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936685.970362:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784936685.970375:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784936685.970381:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524101632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.970410:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524101632:12345-0@lo:400:kworker.0 Request processed in 30us (9535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936685.970416:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784936685.970456:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784936685.970464:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524102016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.970506:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524102016:12345-0@lo:400:kworker.0 Request processed in 43us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936685.970512:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1784936685.970529:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936685.970780:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524101632:0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.970862:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936685.970872:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936685.970904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936685.970912:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524102016:0@lo:400:kworker.0 00000100:00100000:3.0:1784936685.970936:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524101504:0@lo:400:kworker.0 00000100:00100000:3.0:1784936685.970945:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784936685.970950:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524101888:0@lo:400:kworker.0 00000100:00100000:3.0:1784936685.971008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936685.971394:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524101888 00000100:00100000:0.0:1784936685.971400:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524101888 00000100:00100000:0.0:1784936685.971460:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784936685.971468:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524101888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936685.971509:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524101888:12345-0@lo:400:kworker.0 Request processed in 42us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936685.971518:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784936685.971631:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102272 00000100:00100000:2.0:1784936685.971636:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102272 00000100:00100000:2.0:1784936685.971668:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784936685.971676:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524102272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784936685.971726:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936685.971776:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524102272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936685.971782:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784936685.972014:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524101760:0@lo:400:kworker.0 00010000:00080000:0.0:1784936685.972052:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5941c00 x1871641524102272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936685.972067:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524102272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936685.973951:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524101888:0@lo:400:kworker.0 00000100:00100000:3.0:1784936686.525702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936686.525736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936686.525783:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936686.525809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936686.525836:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096320 00000100:00100000:3.0:1784936686.525845:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096320 00000100:00100000:3.0:1784936686.525897:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 278 00000100:00100000:3.0:1784936686.525907:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503096320:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936686.525981:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503096320:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 74us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936686.525989:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 278 00000100:00100000:3.0:1784936686.526025:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096448 00000100:00100000:3.0:1784936686.526029:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096448 00000100:00100000:3.0:1784936686.526060:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096704 00000100:00100000:3.0:1784936686.526074:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096704 00000100:00100000:3.0:1784936686.526097:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:3.0:1784936686.526103:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503096448:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936686.526148:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503096448:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 45us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936686.526156:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:3.0:1784936686.526168:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:3.0:1784936686.526174:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503096704:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936686.526195:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503096704:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 21us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936686.526201:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00080000:3.0:1784936686.530879:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936686.532796:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096576 00000100:00100000:2.0:1784936686.532811:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096576 00000100:00100000:2.0:1784936686.532894:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:2.0:1784936686.532906:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503096576:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936686.532993:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503096576:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 90us (7255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936686.533002:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00080000:1.0:1784936686.533025:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784936686.922574:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936687.945894:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784936688.905087:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784936688.969165:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936689.549139:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784936689.549192:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524102400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936689.549296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936689.549949:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102400 00000100:00100000:0.0:1784936689.549962:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102400 00000100:00100000:0.0:1784936689.550041:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784936689.550054:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524102400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936689.550107:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936689.550220:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524102400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936689.550228:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1784936689.551247:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784936689.560895:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524102400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784936689.992609:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936691.017034:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936691.080869:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524102528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936691.080965:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936691.081633:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524102656:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.081892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936691.081925:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524103168:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.081949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936691.081968:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936691.081973:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524102784:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.081991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936691.082010:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524102912:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.082030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936691.082109:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784936691.082115:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524103040:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.082150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936691.082183:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103040 00000100:00100000:1.0:1784936691.082190:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103040 00000100:00100000:1.0:1784936691.082251:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784936691.082261:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524103040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.082314:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524103040:12345-0@lo:400:kworker.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936691.082321:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1784936691.082341:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936691.082383:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524103040:0@lo:400:kworker.0 00000100:00100000:0.0:1784936691.082461:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102656 00000100:00100000:0.0:1784936691.082474:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102656 00000100:00100000:0.0:1784936691.082513:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784936691.082520:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524102656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936691.082556:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524102656:12345-0@lo:400:kworker.0 Request processed in 37us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936691.082562:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784936691.082607:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102528 00000100:00100000:0.0:1784936691.082611:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102528 00000100:00100000:0.0:1784936691.082735:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784936691.082743:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524102528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936691.082835:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936691.082869:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524102528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936691.082876:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784936691.082958:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103168 00000100:00100000:3.0:1784936691.082963:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103168 00000100:00100000:3.0:1784936691.083010:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102784 00000100:00100000:3.0:1784936691.083013:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102784 00000100:00100000:3.0:1784936691.083026:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524102912 00000100:00100000:3.0:1784936691.083028:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524102912 00000100:00100000:3.0:1784936691.083040:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784936691.083053:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936691.083107:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524103168:12345-0@lo:400:kworker.0 Request processed in 61us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936691.083113:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784936691.083124:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784936691.083129:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524102784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936691.083163:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524102784:12345-0@lo:400:kworker.0 Request processed in 34us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936691.083169:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784936691.083178:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784936691.083183:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524102912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936691.083206:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524102912:12345-0@lo:400:kworker.0 Request processed in 24us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936691.083212:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1784936691.083249:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5941c00 x1871641524102528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936691.083268:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524102528:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784936691.083949:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784936691.083956:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936691.083995:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524102912:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.084023:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524102784:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.084033:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524102656:0@lo:400:kworker.0 00000100:00100000:1.0:1784936691.084454:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524103168:0@lo:400:kworker.0 00000100:00100000:3.0:1784936691.637359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936691.637406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936691.637489:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096832 00000100:00100000:0.0:1784936691.637507:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096832 00000100:00100000:0.0:1784936691.637598:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 280 00000100:00100000:0.0:1784936691.637611:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503096832:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936691.637784:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503096832:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 174us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936691.637793:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 280 00000100:00100000:1.0:1784936691.641465:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503096960 00000100:00100000:1.0:1784936691.641483:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503096960 00000100:00100000:1.0:1784936691.641600:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:1.0:1784936691.641613:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503096960:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936691.641875:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2374:x1871641503096960:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 264us (4467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936691.641884:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00080000:2.0:1784936691.642039:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936691.655816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936691.655940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936691.656008:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097216 00000100:00100000:0.0:1784936691.656022:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097216 00000100:00100000:2.0:1784936691.656324:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097088 00000100:00100000:2.0:1784936691.656330:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097088 00000100:00080000:1.0:1784936691.656949:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784936691.656966:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936691.656996:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1784936691.657009:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2370:x1871641503097088:12345-192.168.204.1@tcp:9:kworker.0 00000020:00000080:2.0:1784936691.657051:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5a6b 00000100:00080000:2.0:1784936691.657063:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096ffa3b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784936691.657266:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:3.0:1784936691.657278:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503097216:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936691.657371:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2374:x1871641503097216:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 96us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936691.657402:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00010000:00010000:3.0:1784936691.657484:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784936691.664162:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1784936691.664602:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+2:2370:x1871641503097088:12345-192.168.204.1@tcp:9:kworker.0 Request processed in 7589us (8795us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936691.664930:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00010000:00010000:2.0:1784936692.040653:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936693.064680:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936694.088810:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936694.667701:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936694.667735:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524103296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936694.667829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936694.667933:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103296 00000100:00100000:1.0:1784936694.667943:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103296 00000100:00100000:1.0:1784936694.668020:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784936694.668032:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524103296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936694.668093:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936694.668145:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524103296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936694.668153:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784936694.668212:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524103296:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784936694.668908:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784936695.113817:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784936695.826673:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:2.0:1784936695.826687:0:6623:0:(genops.c:906:class_export_put()) final put ffff9096ffa3f800/486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:3.0:1784936695.827249:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ffa3f800/486efceb-7a20-41d5-8389-4305380725bf for lustre-OST0000 00000020:00000080:3.0:1784936695.827494:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ffa3b000 for lustre-OST0000 00010000:00010000:2.0:1784936696.136660:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936696.200936:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936696.200961:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524103424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936696.201030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936696.202569:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103424 00000100:00100000:3.0:1784936696.202582:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103424 00000100:00100000:3.0:1784936696.202639:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784936696.202652:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524103424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936696.202693:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936696.202761:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524103424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936696.202768:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1784936696.204074:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784936696.204091:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524103680:0@lo:400:kworker.0 00000100:00100000:2.0:1784936696.204144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936696.204245:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784936696.204253:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524103808:0@lo:400:kworker.0 00000100:00100000:2.0:1784936696.204280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936696.204315:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103680 00000100:00100000:2.0:1784936696.204320:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103680 00000100:00100000:2.0:1784936696.204357:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103808 00000100:00100000:2.0:1784936696.204366:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103808 00000100:00100000:2.0:1784936696.204394:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784936696.204402:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524103680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936696.204534:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524103680:12345-0@lo:400:kworker.0 Request processed in 132us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936696.204543:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784936696.204565:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784936696.204581:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524103808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936696.204612:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524103808:12345-0@lo:400:kworker.0 Request processed in 32us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936696.204618:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1784936696.204645:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936696.204937:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524103936:0@lo:400:kworker.0 00000100:00100000:3.0:1784936696.204974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936696.205001:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784936696.205007:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524103552:0@lo:400:kworker.0 00000100:00100000:3.0:1784936696.205035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936696.205071:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524104064:0@lo:400:kworker.0 00000100:00100000:3.0:1784936696.205094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936696.206007:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524103808:0@lo:400:kworker.0 00000100:00100000:2.0:1784936696.206023:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524103680:0@lo:400:kworker.0 00000100:00100000:1.0:1784936696.206123:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103936 00000100:00100000:1.0:1784936696.206130:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103936 00000100:00100000:1.0:1784936696.206270:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784936696.206279:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524103936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936696.206343:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524103936:12345-0@lo:400:kworker.0 Request processed in 64us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936696.206350:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784936696.206371:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524103552 00000100:00100000:1.0:1784936696.206375:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524103552 00000100:00100000:1.0:1784936696.206400:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784936696.206406:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524103552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936696.206452:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524103552:12345-0@lo:400:kworker.0 Request processed in 46us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936696.206536:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784936696.206585:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524103552:0@lo:400:kworker.0 00000100:00100000:1.0:1784936696.206597:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524103936:0@lo:400:kworker.0 00010000:00080000:2.0:1784936696.206665:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c5940000 x1871641524103424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936696.206685:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c5940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524103424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936696.206707:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104064 00000100:00100000:2.0:1784936696.206711:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104064 00000100:00100000:2.0:1784936696.206746:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784936696.206753:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936696.206795:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524104064:12345-0@lo:400:kworker.0 Request processed in 43us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936696.206801:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784936696.206831:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524104064:0@lo:400:kworker.0 00000100:00080000:3.0:1784936696.208026:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784936696.208034:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784936696.760314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936696.760349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936696.760375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936696.760408:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097600 00000100:00100000:3.0:1784936696.760417:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097600 00000100:00100000:3.0:1784936696.760486:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097472 00000100:00100000:3.0:1784936696.760489:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097472 00000100:00100000:3.0:1784936696.760514:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:3.0:1784936696.760523:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503097600:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936696.760598:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503097600:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936696.760606:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:3.0:1784936696.760622:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:3.0:1784936696.760629:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503097472:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936696.760652:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503097472:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936696.760658:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00080000:3.0:1784936696.760675:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936696.766038:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097344 00000100:00100000:2.0:1784936696.766051:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097344 00000100:00100000:2.0:1784936696.766121:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 282 00000100:00100000:2.0:1784936696.766137:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503097344:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936696.766225:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503097344:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 90us (5917us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936696.766251:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 282 00010000:00010000:0.0:1784936697.160617:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784936698.122752:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784936698.188710:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936699.215593:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936699.785055:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936699.785088:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524104192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936699.785195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936699.785408:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104192 00000100:00100000:1.0:1784936699.785422:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104192 00000100:00100000:1.0:1784936699.785536:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784936699.785549:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524104192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936699.785600:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936699.785669:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524104192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936699.785677:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784936699.785760:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524104192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784936699.785956:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1784936700.130546:0:11716:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:44:58 (1784936698) 00010000:00010000:2.0:1784936700.233706:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936701.256760:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936701.320827:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524104448:0@lo:400:kworker.0 00000100:00100000:0.0:1784936701.320908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936701.320972:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524104960:0@lo:400:kworker.0 00000100:00100000:0.0:1784936701.321003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936701.321033:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936701.321039:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524104576:0@lo:400:kworker.0 00000100:00100000:0.0:1784936701.321060:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936701.321261:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104448 00000100:00100000:3.0:1784936701.321268:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104448 00000100:00100000:3.0:1784936701.321310:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104576 00000100:00100000:3.0:1784936701.321313:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104576 00000100:00100000:3.0:1784936701.321338:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784936701.321346:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524104448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936701.321396:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524104448:12345-0@lo:400:kworker.0 Request processed in 50us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936701.321413:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784936701.321558:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524104448:0@lo:400:kworker.0 00000100:00100000:0.0:1784936701.321573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936701.321581:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524105088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936701.321607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936701.321642:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524105088 00000100:00100000:0.0:1784936701.321646:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524105088 00000100:00100000:0.0:1784936701.321674:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784936701.321681:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524105088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936701.321710:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936701.322589:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524104704:0@lo:400:kworker.0 00000100:00100000:2.0:1784936701.322637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936701.322853:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784936701.322863:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524104320:0@lo:400:kworker.0 00000100:00100000:2.0:1784936701.322897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936701.322929:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524104832:0@lo:400:kworker.0 00000100:00100000:2.0:1784936701.322970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936701.323197:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104960 00000100:00100000:2.0:1784936701.323203:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104960 00000100:00100000:2.0:1784936701.323239:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104704 00000100:00100000:2.0:1784936701.323243:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104704 00000100:00100000:2.0:1784936701.323270:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784936701.323278:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524104960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936701.323365:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524104960:12345-0@lo:400:kworker.0 Request processed in 87us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936701.323375:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784936701.323392:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524105088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1708us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936701.323401:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784936701.323402:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784936701.323412:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524104704:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784936701.323462:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096f4ac0e00 x1871641524105088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936701.323475:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524104704:12345-0@lo:400:kworker.0 Request processed in 64us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936701.323488:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524105088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936701.323503:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784936701.323526:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104320 00000100:00100000:2.0:1784936701.323530:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104320 00000100:00100000:2.0:1784936701.323554:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1784936701.323562:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524104320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936701.323596:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524104832 00000100:00100000:2.0:1784936701.323599:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524104320:12345-0@lo:400:kworker.0 Request processed in 38us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936701.323603:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524104832 00000100:00100000:2.0:1784936701.323611:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784936701.323643:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784936701.323655:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524104576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936701.323692:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524104576:12345-0@lo:400:kworker.0 Request processed in 41us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936701.323697:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784936701.323710:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784936701.323716:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524104832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936701.323796:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524104320:0@lo:400:kworker.0 00000100:00100000:2.0:1784936701.323815:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524104704:0@lo:400:kworker.0 00000100:00100000:3.0:1784936701.324066:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524104832:12345-0@lo:400:kworker.0 Request processed in 349us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936701.324074:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784936701.324163:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524104832:0@lo:400:kworker.0 00000100:00080000:0.0:1784936701.329025:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936701.329037:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936701.329041:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936701.329092:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524104576:0@lo:400:kworker.0 00010000:00080000:0.0:1784936701.329113:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ee3a5880 x1871641524104960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784936717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936701.329150:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524104960:0@lo:400:kworker.0 00000100:00100000:3.0:1784936701.898408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936701.898510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936701.898533:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097728 00000100:00100000:2.0:1784936701.898550:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097728 00000100:00100000:3.0:1784936701.898580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936701.898615:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097856 00000100:00100000:0.0:1784936701.898626:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097856 00000100:00100000:2.0:1784936701.898639:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 284 00000100:00100000:2.0:1784936701.898656:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503097728:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936701.898695:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503097984 00000100:00100000:0.0:1784936701.898700:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503097984 00000100:00100000:3.0:1784936701.898728:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:0.0:1784936701.898740:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:3.0:1784936701.898752:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503097856:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936701.898759:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2371:x1871641503097984:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936701.898775:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503097728:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936701.898786:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 284 00000100:00100000:0.0:1784936701.898829:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2371:x1871641503097984:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936701.898842:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:3.0:1784936701.898849:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503097856:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936701.898864:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00080000:0.0:1784936701.898879:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784936702.280986:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936702.585241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936702.585727:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503098112 00000100:00100000:0.0:1784936702.585738:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503098112 00000100:00100000:0.0:1784936702.585799:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:0.0:1784936702.585808:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+5:10238:x1871641503098112:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936702.585830:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936702.585908:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d02 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936702.585982:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5b3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936702.585995:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936702.586008:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936702.586217:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784936702.586222:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936702.586347:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936702.586372:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d02 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936702.586389:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5b3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d02 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936702.586398:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096caf90700) 00010000:00010000:0.0:1784936702.586401:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784936702.587336:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b400, rc 0) 00000100:00100000:0.0:1784936702.587423:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+6:10238:x1871641503098112:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1613us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936702.587447:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:2.0:1784936702.597890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936702.598087:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503098240 00000100:00100000:1.0:1784936702.598097:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503098240 00000100:00100000:1.0:1784936702.598161:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:1.0:1784936702.598172:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+6:10239:x1871641503098240:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936702.598194:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936702.598226:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5b44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d09 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.598841:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.598867:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.598879:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.598896:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.598904:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.598911:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599705:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd400/0x6cf7a864723f5b59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599715:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd400/0x6cf7a864723f5b59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599723:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd400/0x6cf7a864723f5b59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936702.599801:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784936702.599805:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936702.599876:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd400/0x6cf7a864723f5b59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599886:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599892:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599898:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599903:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fdc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936702.599907:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599928:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599940:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096caf90700) 00010000:00010000:1.0:1784936702.599948:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936702.599953:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599959:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fdc00/0x6cf7a864723f5b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599970:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599975:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599980:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599985:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936702.599988:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.599993:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.600000:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9096c7246300) 00010000:00010000:1.0:1784936702.600003:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936702.600006:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.600012:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd200/0x6cf7a864723f5b52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.600043:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fc600/0x6cf7a864723f5b44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d09 expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.600069:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd400/0x6cf7a864723f5b59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d09 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.600077:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:1.0:1784936702.600079:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936702.600081:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c13fd400, rc 0) 00000100:00100000:1.0:1784936702.600151:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+7:10239:x1871641503098240:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1980us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936702.600159:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:3.0:1784936702.609755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936702.609875:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503098496 00000100:00100000:1.0:1784936702.609886:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503098496 00000100:00100000:1.0:1784936702.609948:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:1.0:1784936702.609959:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+7:10239:x1871641503098496:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936702.609981:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936702.610003:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031e00/0x6cf7a864723f5b60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d10 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610082:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610098:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610111:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610172:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610187:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610195:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610798:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f5b75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610809:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f5b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.610816:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f5b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936702.610827:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784936702.611056:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611066:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611074:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611080:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936702.611084:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611092:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611116:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:1.0:1784936702.611119:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936702.611124:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611131:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031400/0x6cf7a864723f5b67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611144:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611150:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611156:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611161:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936702.611163:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611169:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611176:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9096c7246a00) 00010000:00010000:1.0:1784936702.611178:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936702.611181:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611188:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5b6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611617:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c0031e00/0x6cf7a864723f5b60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d10 expref: 10 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611634:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f5b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d10 expref: 9 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936702.611641:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:1.0:1784936702.611644:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936702.611646:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164800, rc 0) 00000100:00100000:1.0:1784936702.611723:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+9:10239:x1871641503098496:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1765us (1975us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784936702.611731:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1784936702.624011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936702.624199:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503098624 00000100:00100000:3.0:1784936702.624209:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503098624 00000100:00100000:3.0:1784936702.624276:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:3.0:1784936702.624286:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+9:10239:x1871641503098624:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784936702.624473:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+9:10239:x1871641503098624:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 Request processed in 187us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936702.624481:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000040:00080000:2.0:1784936703.242191:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784936703.308479:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936704.335706:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936704.907401:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524105216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936704.907536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936704.907653:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524105216 00000100:00100000:2.0:1784936704.907662:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524105216 00000100:00100000:2.0:1784936704.907739:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784936704.907749:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524105216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784936704.907794:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936704.907851:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524105216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936704.907859:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784936704.907929:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524105216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784936704.910121:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936705.142854:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936705.143517:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503098752 00000100:00100000:0.0:1784936705.143535:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503098752 00000100:00100000:0.0:1784936705.143635:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1784936705.143648:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+9:10282:x1871641503098752:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936705.143681:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936705.143712:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d17 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.143807:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.143846:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.143862:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.143898:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.143907:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.143915:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144510:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144522:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144529:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144536:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936705.144543:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144552:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144567:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096caf90700) 00010000:00010000:0.0:1784936705.144577:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.144585:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144593:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144608:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144614:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144619:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144624:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936705.144627:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144633:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144641:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9096caf90400) 00010000:00010000:0.0:1784936705.144644:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.144647:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144653:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5b91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144702:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5b83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d17 expref: 10 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144725:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096caf90700) 00010000:00010000:0.0:1784936705.144728:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.144732:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d17 expref: 10 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.144743:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26be00, rc 0) 00000100:00100000:0.0:1784936705.144836:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+9:10282:x1871641503098752:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1190us (2000us total) trans 0 rc 301/301 00000100:00100000:0.0:1784936705.144844:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00080000:1.0:1784936705.144975:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936705.159527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936705.159594:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099008 00000100:00100000:2.0:1784936705.159609:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099008 00000100:00100000:2.0:1784936705.159695:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:2.0:1784936705.159708:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+9:10282:x1871641503099008:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:2.0:1784936705.159793:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936705.159831:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5b3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d02 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.159855:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096caf90700) 00010000:00010000:2.0:1784936705.159883:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936705.160294:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.160313:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.160337:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.160354:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.160362:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.160369:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936705.163966:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784936705.163994:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.164008:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.164017:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.164024:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936705.164030:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.164039:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.164061:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:2.0:1784936705.164065:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936705.164079:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.164086:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5b98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936705.164116:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000115d254c reply state 000000002a404d8f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936705.164127:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936705.164834:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+10:10282:x1871641503099008:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 5114us (5304us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784936705.164848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00010000:00010000:0.0:1784936705.166795:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.166820:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.166829:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.166838:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936705.166845:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.166855:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.166890:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9096d7e59000) 00010000:00010000:0.0:1784936705.166894:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.166911:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.166918:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5b9f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936705.335577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936705.336731:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099136 00000100:00100000:2.0:1784936705.336758:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099136 00000100:00100000:2.0:1784936705.336859:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1784936705.336882:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+9:10290:x1871641503099136:12345-192.168.204.1@tcp:101:lctl.0 00010000:00010000:2.0:1784936705.336919:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936705.336954:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d1e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.337060:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f5bad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.337082:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f5bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.337102:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f5bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936705.337198:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784936705.337223:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936705.339053:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f5bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.339118:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d1e expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.339147:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f5bad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d1e expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.339159:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:3.0:1784936705.339163:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936705.339169:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19200, rc 0) 00000100:00100000:3.0:1784936705.341082:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+10:10290:x1871641503099136:12345-192.168.204.1@tcp:101:lctl.0 Request processed in 4187us (5506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936705.341099:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00010000:00010000:1.0:1784936705.352706:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936705.425506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936705.426823:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099264 00000100:00100000:0.0:1784936705.426841:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099264 00000100:00100000:0.0:1784936705.427664:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:0.0:1784936705.428219:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+10:10296:x1871641503099264:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936705.428252:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936705.428283:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d25 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.428391:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.428410:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.428425:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.428468:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.428476:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.428482:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430120:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430135:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430146:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936705.430249:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1784936705.430254:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936705.430358:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430377:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430384:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430391:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430399:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936705.430404:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430412:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430450:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:0.0:1784936705.430460:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.430467:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430474:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430490:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430495:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430501:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430507:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936705.430510:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430515:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430523:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9096caf90400) 00010000:00010000:0.0:1784936705.430526:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.430529:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430534:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5bc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430582:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d25 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430610:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d25 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.430620:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936705.430623:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784936705.430626:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26be00, rc 0) 00000100:00100000:0.0:1784936705.430728:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+11:10296:x1871641503099264:12345-192.168.204.1@tcp:101:bash.0 Request processed in 3048us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936705.430737:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:1.0:1784936705.435134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936705.435478:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099520 00000100:00100000:1.0:1784936705.435491:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099520 00000100:00100000:1.0:1784936705.435568:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:1.0:1784936705.435582:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+11:10296:x1871641503099520:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936705.435612:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936705.435699:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f5bd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d2c expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.436318:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.436348:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.436363:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.440888:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.440918:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.440933:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784936705.445682:0:6621:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784936705.446202:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446222:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446234:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446273:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446280:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446287:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446301:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936705.446306:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446315:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446329:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936705.446333:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936705.446338:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446344:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5bd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936705.446359:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4ceea8e reply state 0000000007ad014c transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936705.446368:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784936705.446410:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f5bd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 14 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446474:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 13 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.446483:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:1.0:1784936705.446485:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936705.446488:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165c00, rc 0) 00000100:00100000:1.0:1784936705.446585:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+14:10296:x1871641503099520:12345-192.168.204.1@tcp:101:bash.0 Request processed in 11006us (11465us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784936705.446599:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00010000:00010000:0.0:1784936705.452478:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.452496:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.452503:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.452510:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936705.452515:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.452524:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.452541:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096c7246a00) 00010000:00010000:0.0:1784936705.452544:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936705.452548:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.452570:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5bde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936705.459153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936705.460780:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099648 00000100:00100000:0.0:1784936705.460795:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099648 00000100:00100000:0.0:1784936705.460849:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1784936705.460872:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1871641503099648:12345-192.168.204.1@tcp:8:bash.0 00010000:00080000:0.0:1784936705.460911:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:0.0:1784936705.460942:0:6597:0:(genops.c:1406:class_connect()) connect: client 486efceb-7a20-41d5-8389-4305380725bf, cookie 0x6cf7a864723f5bf3 00002000:00100000:0.0:1784936705.460955:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 486efceb-7a20-41d5-8389-4305380725bf/ffff9096ee263000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784936705.460980:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784936705.461257:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784936705.461295:0:6597:0:(import.c:65:import_set_state_nolock()) ffff9096ee266000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936705.461613:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2370:x1871641503099648:12345-192.168.204.1@tcp:8:bash.0 Request processed in 753us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936705.461622:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1784936705.489953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936705.490579:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099776 00000100:00100000:1.0:1784936705.490603:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099776 00000100:00100000:1.0:1784936705.491545:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:1.0:1784936705.491566:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:0:x1871641503099776:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936705.491596:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936705.491628:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d33 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784936705.491663:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:0.0:1784936705.492181:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784936705.492620:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1784936705.492631:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936705.492650:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.493496:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.493523:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164400, rc 0) 00000100:00100000:0.0:1784936705.494096:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:0:x1871641503099776:12345-192.168.204.1@tcp:101:bash.0 Request processed in 2529us (4145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936705.494109:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:3.0:1784936705.498897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936705.498999:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503099904 00000100:00100000:1.0:1784936705.499028:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503099904 00000100:00100000:1.0:1784936705.499132:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:1.0:1784936705.499148:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:10296:x1871641503099904:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936705.499177:0:8072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936705.499215:0:8072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d3a expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.499299:0:8072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.499313:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936705.499319:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936705.499327:0:8072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 8 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.499553:0:8072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936705.499578:0:8072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936705.499600:0:8072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8072:1871641524105344:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936705.499935:0:8072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936705.519110:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936705.519185:0:8072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8072:1871641524105344:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936705.519242:0:8072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 8 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.519273:0:8072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165000, rc 0) 00000100:00100000:3.0:1784936705.519352:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+8:10296:x1871641503099904:12345-192.168.204.1@tcp:101:bash.0 Request processed in 20208us (20469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936705.519610:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:2.0:1784936705.520078:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503100032 00000100:00100000:2.0:1784936705.520090:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503100032 00010000:00010000:2.0:1784936705.520139:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936705.520188:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:2.0:1784936705.520202:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503100032:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936705.520224:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936705.520269:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.520289:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.520408:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f5bfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d33 expref: 8 pid: 6598 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.520558:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936705.520564:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936705.520574:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.520587:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.520660:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936705.520680:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0115c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5781:1871641524105472:192.168.204.1@tcp:105: 00000100:00100000:2.0:1784936705.520793:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927540 going to sleep for 11 seconds 00000100:00100000:2.0:1784936705.526461:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0115c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5781:1871641524105472:192.168.204.1@tcp:105: 00010000:00010000:2.0:1784936705.526502:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936705.526581:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503100032:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 6381us (7488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936705.526595:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:2.0:1784936705.532625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936705.532828:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503100288 00000100:00100000:1.0:1784936705.532843:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503100288 00000100:00100000:1.0:1784936705.532945:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936705.532960:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+13:10296:x1871641503100288:12345-192.168.204.1@tcp:35:bash.0 00000001:00080000:3.0:1784936705.533543:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:3.0:1784936705.533561:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:0.0:1784936705.534327:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+12:10296:x1871641503100288:12345-192.168.204.1@tcp:35:bash.0 Request processed in 1360us (1707us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784936705.534342:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936705.714010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936705.714165:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503100544 00000100:00100000:2.0:1784936705.714181:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503100544 00000100:00100000:2.0:1784936705.714289:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:2.0:1784936705.714305:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+12:10307:x1871641503100544:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936705.714342:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936705.714377:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5c08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d41 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936705.714680:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1784936705.714883:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5c08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d41 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.714902:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:0.0:1784936705.714906:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936705.714911:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5c08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d41 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.714929:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19400, rc 0) 00000100:00100000:0.0:1784936705.715597:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+13:10307:x1871641503100544:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1293us (1601us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1784936705.715607:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:1.0:1784936705.728552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936705.729256:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503100800 00000100:00100000:2.0:1784936705.729268:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503100800 00000100:00100000:2.0:1784936705.729338:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1784936705.729350:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+13:10307:x1871641503100800:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936705.730490:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+14:10307:x1871641503100800:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 1135us (1944us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784936705.730517:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1784936705.847255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936705.847378:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503100928 00000100:00100000:0.0:1784936705.847399:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503100928 00000100:00100000:0.0:1784936705.847541:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:0.0:1784936705.847552:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:10313:x1871641503100928:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936705.847581:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936705.847605:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5c16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d48 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.847673:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.847687:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.847700:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936705.847785:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1784936705.847789:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936705.847814:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.847843:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5c16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d48 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.849849:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d48 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.849878:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936705.849881:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784936705.849885:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b400, rc 0) 00000100:00100000:0.0:1784936705.850197:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:10313:x1871641503100928:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2644us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936705.850206:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:1.0:1784936705.860058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936705.860199:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503101184 00000100:00100000:3.0:1784936705.860214:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503101184 00000100:00100000:3.0:1784936705.860317:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1784936705.860331:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+15:10313:x1871641503101184:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936705.860362:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936705.860392:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d4f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.860565:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.860583:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.860599:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936705.860614:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784936705.861123:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d4f expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.861152:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d4f expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.861190:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:3.0:1784936705.861193:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936705.861198:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4a00, rc 0) 00000100:00100000:3.0:1784936705.861400:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+17:10313:x1871641503101184:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1070us (1356us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784936705.861408:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1784936705.866779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936705.866972:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503101440 00000100:00100000:0.0:1784936705.866985:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503101440 00000100:00100000:0.0:1784936705.867068:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:0.0:1784936705.867081:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+17:10313:x1871641503101440:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936705.867119:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936705.867161:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d56 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.867398:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5c40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.867482:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.867498:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5c40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936705.867515:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784936705.867694:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d56 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.867717:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d56 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.867727:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:0.0:1784936705.867730:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784936705.867735:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ae00, rc 0) 00000100:00100000:0.0:1784936705.867820:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+19:10313:x1871641503101440:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 741us (1064us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784936705.867829:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:3.0:1784936705.868996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936705.869144:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503101568 00000100:00100000:0.0:1784936705.869164:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503101568 00000100:00100000:0.0:1784936705.869240:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:0.0:1784936705.869251:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+19:2372:x1871641503101568:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936705.869270:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936705.869299:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d4f expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936705.869344:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:0.0:1784936705.869350:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936705.869397:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+18:2372:x1871641503101568:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 148us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936705.869405:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:3.0:1784936705.883923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936705.884071:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503101696 00000100:00100000:2.0:1784936705.884087:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503101696 00000100:00100000:2.0:1784936705.884227:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1784936705.884241:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2374:x1871641503101696:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:2.0:1784936705.884307:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.884336:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.884347:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936705.884352:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936705.884357:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.884416:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.884490:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 7 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936705.884511:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6595:1871641524105600:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936705.884642:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936705.890413:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6595:1871641524105600:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936705.890513:0:6595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936705.895670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936705.895796:0:6601:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503101824 00000100:00100000:2.0:1784936705.895815:0:6601:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503101824 00002000:00100000:2.0:1784936705.895895:0:6601:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9096ede57100 x1871641503101824/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:446/0 lens 504/0 e 0 to 0 dl 1784936716 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784936705.895909:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ede57100 with x1871641503101824 ext(0->12) 00010000:00010000:2.0:1784936705.895921:0:6601:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 8 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936705.895945:0:6601:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 8 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784936705.895954:0:6601:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9096ede57100 00000100:00100000:2.0:1784936705.896060:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1784936705.896075:0:6601:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503101824:12345-192.168.204.1@tcp:4:lfs.0 00000001:00100000:0.0:1784936705.987303:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000100:00100000:3.0:1784936705.989249:0:6601:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2371:x1871641503101824:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 93167us (93583us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784936705.989268:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00002000:00100000:3.0:1784936705.989282:0:6601:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9096ede57100 x1871641503101824/t4294967299(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:446/0 lens 504/448 e 0 to 0 dl 1784936716 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936705.989293:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ede57100 with x1871641503101824 ext(0->12) 00010000:00010000:3.0:1784936705.989304:0:6601:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 9 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936705.989327:0:6601:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 9 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936705.989337:0:6601:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9096ede57100 00000100:00100000:0.0:1784936706.007187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936706.007309:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503101952 00000100:00100000:2.0:1784936706.007322:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503101952 00010000:00010000:2.0:1784936706.007375:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 9 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936706.007422:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:2.0:1784936706.007461:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2371:x1871641503101952:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936706.007478:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784936706.007514:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784936706.007518:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784936705 00002000:00010000:2.0:1784936706.007520:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784936705 00002000:00010000:2.0:1784936706.007523:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784936705 00010000:00010000:2.0:1784936706.007530:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 9 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.007547:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 9 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.007573:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f5c01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d3a expref: 9 pid: 8072 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.007592:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936706.007597:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936706.007604:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.007616:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.007655:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936706.007727:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503101952:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 267us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936706.007735:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00010000:00010000:1.0:1784936706.007825:0:6595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007842:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007881:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007891:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007901:0:6595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007909:0:6595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936706.007913:0:6595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007924:0:6595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007937:0:6595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.007945:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f5c4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936706.008028:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2374:x1871641503101696:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 123790us (124128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936706.008037:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:0.0:1784936706.018465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936706.018615:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503102208 00000100:00100000:1.0:1784936706.018624:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503102208 00000100:00100000:1.0:1784936706.018678:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1784936706.018686:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+18:10313:x1871641503102208:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:1.0:1784936706.018749:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5c40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d56 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936706.019046:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1784936706.019093:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1784936706.019779:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1784936706.019845:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.019878:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 22 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.019888:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.019925:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 22 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.019943:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 22 pid: 6621 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936706.019972:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1871641524105728:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936706.020085:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7eb4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936706.030404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936706.030634:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503102336 00000100:00100000:2.0:1784936706.030645:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503102336 00010000:00010000:2.0:1784936706.030687:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 23 pid: 6621 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936706.030742:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:2.0:1784936706.030753:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+23:2372:x1871641503102336:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936706.030771:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936706.030779:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 23 pid: 6621 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.030795:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 23 pid: 6621 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.030818:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:2.0:1784936706.030825:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.030837:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.030846:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.030878:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936706.030934:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+23:2372:x1871641503102336:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 183us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936706.030942:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00010000:00010000:1.0:1784936706.033190:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f5be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d2c expref: 22 pid: 6621 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936706.033219:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1871641524105728:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936706.033247:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.033258:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.033264:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936706.033419:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1784936706.033700:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1784936706.033844:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524105856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784936706.033926:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936706.036223:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936706.042611:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524105856 00000100:00100000:0.0:1784936706.042628:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524105856 00000100:00100000:0.0:1784936706.042749:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936706.042759:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1871641524105856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784936706.042907:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1871641524105856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (8981us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936706.042916:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936706.044185:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede90000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524105856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784936706.044977:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1784936706.045990:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524105984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784936706.046175:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936706.046229:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7eb4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936706.046417:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524105984 00000100:00100000:3.0:1784936706.046452:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524105984 00000100:00100000:3.0:1784936706.046496:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936706.046505:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5799:x1871641524105984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784936706.046712:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5799:x1871641524105984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 207us (536us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784936706.046721:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784936706.047144:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524105984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784936706.047231:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1784936706.047284:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.047296:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.047304:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.047311:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936706.047315:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.047323:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.047338:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:2.0:1784936706.047341:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784936706.047346:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936706.047351:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784936706.047578:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784936706.047810:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1784936706.047822:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371799393209ns, next at 372799391256ns, rc = 0 00000001:00080000:2.0:1784936706.047836:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1784936706.047886:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246300) 00010000:00010000:2.0:1784936706.047889:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784936706.047897:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5c40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d56 expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936706.048000:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+25:10313:x1871641503102208:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 29313us (29543us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1784936706.054305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936706.054384:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503102464 00000100:00100000:3.0:1784936706.054400:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503102464 00000100:00100000:3.0:1784936706.054547:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:3.0:1784936706.054564:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+26:10313:x1871641503102464:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936706.054603:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936706.054638:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f5c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d5d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.054730:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f5c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d5d expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.054752:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f5c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d5d expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.054777:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936706.054782:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784936706.054787:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4200, rc 0) 00000100:00100000:3.0:1784936706.054882:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+27:10313:x1871641503102464:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 321us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936706.054915:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:2.0:1784936706.056926:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000020:00080000:2.0:1784936706.056941:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1784936706.062130:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936706.076521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936706.076617:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503102720 00000100:00100000:2.0:1784936706.076633:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503102720 00000100:00100000:3.0:1784936706.076814:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936706.076827:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8817850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+26:10313:x1871641503102720:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936706.077225:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8817850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+27:10313:x1871641503102720:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 399us (719us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1784936706.077233:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1784936706.218651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936706.218898:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503102976 00000100:00100000:3.0:1784936706.218913:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503102976 00000100:00100000:3.0:1784936706.219540:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:3.0:1784936706.219557:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:10323:x1871641503102976:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936706.219603:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936706.219634:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d64 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936706.219968:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1784936706.220302:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d64 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.220324:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:3.0:1784936706.220327:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784936706.220333:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d64 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.220356:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5600, rc 0) 00000100:00100000:3.0:1784936706.220561:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+28:10323:x1871641503102976:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1006us (1925us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1784936706.220587:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:1.0:1784936706.226606:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936706.226766:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503103104 00000100:00100000:3.0:1784936706.226780:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503103104 00000100:00100000:3.0:1784936706.226903:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:3.0:1784936706.226916:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+28:10323:x1871641503103104:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:3.0:1784936706.227061:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227084:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227100:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227118:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227125:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227131:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227274:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227283:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227290:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936706.227371:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227389:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227395:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227403:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227410:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936706.227415:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227424:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227480:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:3.0:1784936706.227483:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936706.227489:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227496:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5c71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227515:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227522:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227535:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227540:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936706.227543:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227549:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227558:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d173a900) 00010000:00010000:3.0:1784936706.227560:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936706.227563:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227569:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5c78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227605:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227611:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227616:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227621:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936706.227623:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227639:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227647:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936706.227650:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936706.227652:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936706.227658:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936706.227947:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+28:10323:x1871641503103104:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1030us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936706.227957:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:0.0:1784936706.230314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936706.231771:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503103360 00000100:00100000:2.0:1784936706.231789:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503103360 00000100:00100000:2.0:1784936706.231920:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:2.0:1784936706.231934:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+28:10323:x1871641503103360:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936706.232350:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+29:10323:x1871641503103360:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 417us (2050us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1784936706.232360:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:0.0:1784936706.323283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936706.323546:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503103616 00000100:00100000:1.0:1784936706.323561:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503103616 00000100:00100000:1.0:1784936706.323649:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:1.0:1784936706.323671:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+29:10326:x1871641503103616:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936706.323730:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936706.323761:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d6b expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.323883:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.323902:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.323920:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.323940:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.323949:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.323957:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324161:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324171:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324178:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936706.324189:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784936706.324334:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324343:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324350:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324356:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936706.324361:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324370:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324385:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936706.324389:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936706.324395:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324402:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f5c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.324420:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.325332:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.325347:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.325371:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936706.325375:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.325382:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.325394:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096c7246400) 00010000:00010000:1.0:1784936706.325398:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936706.325403:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.325409:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.326001:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f5c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 32 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.326022:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 31 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936706.326032:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:1.0:1784936706.326035:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936706.326038:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165200, rc 0) 00000100:00100000:1.0:1784936706.326142:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+31:10326:x1871641503103616:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2481us (2872us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1784936706.326153:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:1.0:1784936706.331128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936706.331314:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503103744 00000100:00100000:0.0:1784936706.331329:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503103744 00000100:00100000:0.0:1784936706.331417:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1784936706.331468:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+31:10326:x1871641503103744:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1784936706.331577:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331599:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331622:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331665:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331673:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331681:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331689:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936706.331695:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331704:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331721:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936706.331724:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936706.331731:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.331738:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936706.331855:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+31:10326:x1871641503103744:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 416us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936706.331864:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:1.0:1784936706.334945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936706.335161:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503104000 00000100:00100000:3.0:1784936706.335178:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503104000 00000100:00100000:3.0:1784936706.335271:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1784936706.335286:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+31:10326:x1871641503104000:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936706.336091:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+32:10326:x1871641503104000:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 802us (1155us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1784936706.336103:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00010000:00010000:2.0:1784936706.378393:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936706.440867:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524106496:0@lo:400:kworker.0 00000100:00100000:3.0:1784936706.440975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936706.441069:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784936706.441077:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524106112:0@lo:400:kworker.0 00000100:00100000:3.0:1784936706.441115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936706.441151:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524106624:0@lo:400:kworker.0 00000100:00100000:3.0:1784936706.441222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936706.441292:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524106368:0@lo:400:kworker.0 00000100:00100000:2.0:1784936706.441334:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936706.441374:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524106880:0@lo:400:kworker.0 00000100:00100000:2.0:1784936706.441403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936706.441404:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524106240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936706.441490:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106624 00000100:00100000:3.0:1784936706.441501:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106624 00000100:00100000:3.0:1784936706.441584:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106880 00000100:00100000:3.0:1784936706.441587:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106880 00000100:00100000:3.0:1784936706.441617:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784936706.441627:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524106624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936706.441692:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524106624:12345-0@lo:400:kworker.0 Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936706.441700:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784936706.441724:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784936706.441731:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524106880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936706.441887:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106496 00000100:00100000:0.0:1784936706.441902:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106496 00000100:00100000:0.0:1784936706.441936:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106368 00000100:00100000:0.0:1784936706.441939:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106368 00000100:00100000:0.0:1784936706.441963:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784936706.441971:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524106496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936706.442012:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524106496:12345-0@lo:400:kworker.0 Request processed in 42us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936706.442018:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784936706.442031:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784936706.442037:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524106368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936706.444586:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936706.450694:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524106880:12345-0@lo:400:kworker.0 Request processed in 8942us (9271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936706.450719:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784936706.451469:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524106752:0@lo:400:kworker.0 00000100:00100000:1.0:1784936706.451562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936706.451672:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106752 00000100:00100000:1.0:1784936706.451682:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106752 00000100:00100000:1.0:1784936706.451751:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784936706.451763:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524106368:12345-0@lo:400:kworker.0 Request processed in 9721us (10423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936706.451775:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784936706.451776:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524106752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936706.451837:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106240 00000100:00100000:0.0:1784936706.451855:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106240 00000100:00100000:1.0:1784936706.451873:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524106752:12345-0@lo:400:kworker.0 Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936706.451880:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784936706.451900:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784936706.451937:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524106752:0@lo:400:kworker.0 00000100:00100000:1.0:1784936706.451990:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524106112 00000100:00100000:1.0:1784936706.451994:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524106112 00000100:00100000:0.0:1784936706.452029:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524106240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936706.452031:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1784936706.452047:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524106112:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784936706.452058:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936706.452096:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524106112:12345-0@lo:400:kworker.0 Request processed in 53us (10980us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936706.452104:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784936706.452120:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524106240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (7546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936706.452127:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784936706.452301:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524106112:0@lo:400:kworker.0 00000100:00100000:3.0:1784936706.452319:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524106624:0@lo:400:kworker.0 00000100:00100000:3.0:1784936706.452334:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524106496:0@lo:400:kworker.0 00000100:00080000:3.0:1784936706.452369:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784936706.452376:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936706.454412:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524106240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936706.457709:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524106368:0@lo:400:kworker.0 00000100:00100000:2.0:1784936706.457738:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524106880:0@lo:400:kworker.0 00000100:00100000:1.0:1784936706.938170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936706.938358:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503104256 00000100:00100000:0.0:1784936706.938373:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503104256 00000100:00100000:0.0:1784936706.938490:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:0.0:1784936706.938505:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+32:10357:x1871641503104256:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:0.0:1784936706.938545:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936706.938577:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d72 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.938761:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.938889:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.938908:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936706.938923:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784936706.939135:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d72 expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.939158:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d72 expref: 34 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936706.939241:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936706.939245:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936706.939249:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b800, rc 0) 00000100:00100000:0.0:1784936706.939340:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+34:10357:x1871641503104256:12345-192.168.204.1@tcp:101:cat.0 Request processed in 838us (1196us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1784936706.939351:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:2.0:1784936706.948006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936706.948087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936706.948697:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503104640 00000100:00100000:0.0:1784936706.948716:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503104640 00000100:00100000:1.0:1784936706.951598:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503104512 00000100:00100000:0.0:1784936706.951604:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:1.0:1784936706.951622:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503104512 00000100:00100000:0.0:1784936706.951641:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d464a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+35:2371:x1871641503104640:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936706.951668:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936706.951723:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d72 expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936706.951739:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00010000:00010000:0.0:1784936706.951747:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936706.951755:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936706.951762:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+34:10357:x1871641503104512:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:0.0:1784936706.951858:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d464a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+34:2371:x1871641503104640:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 234us (3768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936706.951868:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1784936706.952215:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+34:10357:x1871641503104512:12345-192.168.204.1@tcp:35:cat.0 Request processed in 463us (4228us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784936706.952223:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936707.004967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936707.005025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936707.005080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936707.005393:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503104896 00000100:00100000:3.0:1784936707.005407:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503104896 00000100:00100000:3.0:1784936707.005526:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:3.0:1784936707.005536:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2373:x1871641503104896:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936707.005637:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2373:x1871641503104896:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 102us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936707.005662:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:2.0:1784936707.005779:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503104768 00000100:00100000:2.0:1784936707.005784:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503104768 00000100:00100000:2.0:1784936707.005844:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 286 00000100:00100000:2.0:1784936707.005852:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503104768:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936707.005888:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503104768:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 37us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936707.005894:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 286 00000100:00080000:1.0:1784936707.006273:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936707.006355:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503105024 00000100:00100000:0.0:1784936707.006362:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503105024 00000100:00100000:0.0:1784936707.006419:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:0.0:1784936707.006453:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503105024:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936707.006500:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503105024:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 75us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936707.006508:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00080000:1.0:1784936707.006591:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936707.083601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936707.083798:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503105280 00000100:00100000:0.0:1784936707.083814:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503105280 00000100:00100000:0.0:1784936707.083932:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1784936707.083945:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+34:10363:x1871641503105280:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:0.0:1784936707.083984:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936707.083988:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784936707.084027:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d48 expref: 34 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.084081:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936707.084088:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936707.084107:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d79 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.084257:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.084288:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 34 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.084298:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.084350:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 34 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.084369:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 34 pid: 6621 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936707.084389:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524107008:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936707.084604:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c64600 going to sleep for 11 seconds 00000100:00080000:1.0:1784936707.085468:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936707.088994:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524107008:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936707.089040:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936707.091259:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936707.092219:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503105408 00000100:00100000:3.0:1784936707.092237:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503105408 00010000:00010000:3.0:1784936707.092300:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 35 pid: 6621 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936707.092928:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:3.0:1784936707.092944:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+35:2372:x1871641503105408:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936707.092975:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936707.092986:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 35 pid: 6621 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.093007:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 35 pid: 6621 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.093038:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f5c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d6b expref: 35 pid: 6621 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.093060:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936707.093067:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.093079:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.093088:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.093162:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936707.093251:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+34:2372:x1871641503105408:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 311us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936707.093259:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00010000:00010000:1.0:1784936707.094007:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.094022:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936707.094051:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784936707.094314:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5cc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.094339:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 34 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.094348:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:1.0:1784936707.094351:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784936707.094354:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26aa00, rc 0) 00000100:00100000:1.0:1784936707.094474:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+34:10363:x1871641503105280:12345-192.168.204.1@tcp:101:dd.0 Request processed in 10485us (10845us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1784936707.094484:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:1.0:1784936707.109976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936707.110185:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503105664 00000100:00100000:0.0:1784936707.110234:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503105664 00000100:00100000:0.0:1784936707.110320:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:0.0:1784936707.110333:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+34:10363:x1871641503105664:12345-192.168.204.1@tcp:36:dd.0 00010000:00010000:0.0:1784936707.110797:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.110843:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.110857:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936707.110920:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1784936707.110946:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ecc0a2e reply state 00000000ca5cc904 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936707.110958:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936707.111608:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+37:10363:x1871641503105664:12345-192.168.204.1@tcp:36:dd.0 Request processed in 1271us (1644us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784936707.111618:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000020:00080000:0.0:1784936707.111626:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784936707.124854:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.124879:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.124889:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.124896:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936707.124902:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.124942:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.124974:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936707.124978:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936707.124985:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.124992:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5cda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.404905:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936707.418544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936707.418678:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503105792 00000100:00100000:3.0:1784936707.418695:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503105792 00000100:00100000:3.0:1784936707.418779:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:3.0:1784936707.418792:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+36:10377:x1871641503105792:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:3.0:1784936707.418843:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936707.418875:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d80 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.418970:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.418990:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419003:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419020:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419027:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419033:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419197:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419210:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419220:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419269:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.419289:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 37 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936707.419305:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524107136:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936707.419489:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784936707.427841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936707.427948:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503106048 00000100:00100000:0.0:1784936707.427961:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503106048 00000100:00100000:0.0:1784936707.428044:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1784936707.428057:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+38:5588:x1871641503106048:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784936707.428562:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+39:5588:x1871641503106048:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 507us (743us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1784936707.428572:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1784936707.432715:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb2f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524107136:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936707.432784:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936707.436621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936707.436924:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503106176 00000100:00100000:3.0:1784936707.436938:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503106176 00010000:00010000:3.0:1784936707.436996:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 39 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936707.437301:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:3.0:1784936707.437316:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+39:2371:x1871641503106176:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936707.437346:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936707.437356:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 39 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.437375:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 39 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.437404:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ccc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d79 expref: 39 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.437425:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936707.437488:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.437501:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.437510:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.437542:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936707.437611:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+38:2371:x1871641503106176:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 299us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936707.437619:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00010000:00010000:2.0:1784936707.439346:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439367:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936707.439458:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784936707.439464:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936707.439519:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439537:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439549:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439556:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439584:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439591:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936707.439596:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439604:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439622:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936707.439625:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936707.439630:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439636:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439656:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439932:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439938:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439943:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936707.439946:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439961:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439969:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d173a900) 00010000:00010000:2.0:1784936707.439972:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936707.439975:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.439980:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.440054:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d80 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.440071:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d80 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.440080:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:2.0:1784936707.440082:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936707.440085:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:2.0:1784936707.440379:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+37:10377:x1871641503105792:12345-192.168.204.1@tcp:101:stat.0 Request processed in 21586us (21848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936707.440390:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1784936707.560589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936707.561092:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503106432 00000100:00100000:3.0:1784936707.561108:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503106432 00000100:00100000:3.0:1784936707.561256:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:3.0:1784936707.561270:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+37:10383:x1871641503106432:12345-192.168.204.1@tcp:36:truncate.0 00010000:00010000:3.0:1784936707.561398:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936707.561477:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d80 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.561505:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936707.561512:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936707.563229:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.563259:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936707.563273:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784936707.563364:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1784936707.563396:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d94724d5 reply state 00000000c0b79949 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936707.563408:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784936707.563610:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+39:10383:x1871641503106432:12345-192.168.204.1@tcp:36:truncate.0 Request processed in 2339us (3032us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1784936707.563621:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000020:00080000:3.0:1784936707.563628:0:6621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784936707.572693:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.572717:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.572727:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.572734:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936707.572740:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.572770:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.572792:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936707.572796:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936707.572801:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936707.572807:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5cfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936707.809452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936707.814419:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503106560 00000100:00100000:1.0:1784936707.814458:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503106560 00000100:00100000:1.0:1784936707.814574:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:1.0:1784936707.814586:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+38:10397:x1871641503106560:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:1.0:1784936707.814622:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936707.814655:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d87 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.814997:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815018:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815033:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815052:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815059:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815066:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815485:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815497:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815529:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936707.815576:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1784936707.815581:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936707.815611:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815627:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815637:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815644:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815651:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815743:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936707.815751:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815761:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815776:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936707.815780:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936707.815785:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815802:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5d0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815828:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815835:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815841:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815846:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936707.815849:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815856:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815864:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096c7246400) 00010000:00010000:1.0:1784936707.815867:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936707.815870:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815947:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.815992:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.816008:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936707.816022:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:1.0:1784936707.816026:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936707.816029:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165800, rc 0) 00000100:00100000:1.0:1784936707.816211:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+39:10397:x1871641503106560:12345-192.168.204.1@tcp:101:stat.0 Request processed in 1625us (6790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936707.816220:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:1.0:1784936707.954218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936707.954479:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503106816 00000100:00100000:0.0:1784936707.954494:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503106816 00000100:00100000:3.0:1784936707.955059:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:3.0:1784936707.955081:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+39:10407:x1871641503106816:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936707.955178:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936707.955266:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5d20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d8e expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936707.956183:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1784936707.956583:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5d20 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d8e expref: 41 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.956624:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:2.0:1784936707.956627:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936707.956635:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d8e expref: 41 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936707.956657:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:2.0:1784936707.956976:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+40:10407:x1871641503106816:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1902us (2769us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1784936707.956986:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:0.0:1784936707.962787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936707.963382:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503107072 00000100:00100000:2.0:1784936707.963397:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503107072 00000100:00100000:2.0:1784936707.963617:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1784936707.963631:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+40:10407:x1871641503107072:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936707.964055:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+41:10407:x1871641503107072:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 427us (1282us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1784936707.964066:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:0.0:1784936708.083828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936708.083950:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503107328 00000100:00100000:2.0:1784936708.083965:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503107328 00000100:00100000:2.0:1784936708.084045:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:2.0:1784936708.084057:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+41:10413:x1871641503107328:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936708.084103:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936708.084132:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5d2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d95 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.084280:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.084312:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.084322:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.084368:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.084389:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 42 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936708.084406:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524107264:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936708.084582:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a55d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784936708.091160:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7c69500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524107264:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936708.091317:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936708.092925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936708.093347:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503107456 00000100:00100000:3.0:1784936708.093360:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503107456 00010000:00010000:3.0:1784936708.093420:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 43 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936708.093516:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:3.0:1784936708.093529:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+43:2372:x1871641503107456:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936708.093552:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936708.093561:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 43 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.093579:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 43 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.093610:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f5d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d87 expref: 43 pid: 5797 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.093632:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936708.093639:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.093651:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.093672:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.093739:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936708.093838:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+42:2372:x1871641503107456:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 311us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936708.093848:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00010000:00010000:0.0:1784936708.094116:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.094126:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936708.094153:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1784936708.094508:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.094530:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.094540:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936708.094551:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784936708.094555:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18400, rc 0) 00000100:00100000:0.0:1784936708.094591:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+42:10413:x1871641503107328:12345-192.168.204.1@tcp:101:bash.0 Request processed in 10537us (10790us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1784936708.094600:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:3.0:1784936708.104966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.105115:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503107712 00000100:00100000:0.0:1784936708.105129:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503107712 00000100:00100000:0.0:1784936708.105222:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1784936708.105236:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+42:10413:x1871641503107712:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:0.0:1784936708.105688:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.105714:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.105729:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936708.105795:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1784936708.105835:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2e1a64e reply state 00000000e75eb092 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936708.105847:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936708.105986:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+45:10413:x1871641503107712:12345-192.168.204.1@tcp:36:bash.0 Request processed in 751us (1034us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1784936708.105994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000020:00080000:0.0:1784936708.106000:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784936708.108182:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.108262:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.108292:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.108301:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ba00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936708.108308:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.108317:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.108341:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936708.108345:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936708.108351:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.108358:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936708.112994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.113259:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503107840 00000100:00100000:0.0:1784936708.113274:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503107840 00000100:00100000:0.0:1784936708.113369:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1784936708.113383:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+44:10413:x1871641503107840:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936708.113421:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936708.113475:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5d4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94d9c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.113632:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.113651:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 45 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.113670:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.113714:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 45 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.113735:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 45 pid: 5798 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936708.113753:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524107392:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936708.113888:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c64240 going to sleep for 11 seconds 00000100:00100000:0.0:1784936708.117295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936708.117538:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503107968 00000100:00100000:3.0:1784936708.117551:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503107968 00010000:00010000:3.0:1784936708.117608:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 46 pid: 5798 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936708.117657:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:3.0:1784936708.117683:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+46:2372:x1871641503107968:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936708.117705:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936708.117713:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 46 pid: 5798 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.117733:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 46 pid: 5798 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.117765:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:3.0:1784936708.117771:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.117783:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.117825:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936708.117851:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936708.117922:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+46:2372:x1871641503107968:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 241us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936708.117931:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00010000:00010000:2.0:1784936708.118414:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d95 expref: 45 pid: 5798 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936708.118483:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524107392:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936708.118511:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.118522:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.118540:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936708.118599:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784936708.118604:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936708.118637:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.118689:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f5d4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d9c expref: 45 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.118708:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d9c expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.118717:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:2.0:1784936708.118720:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936708.118723:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a000, rc 0) 00000100:00100000:2.0:1784936708.118760:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+44:10413:x1871641503107840:12345-192.168.204.1@tcp:101:bash.0 Request processed in 5380us (5783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936708.118769:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1784936708.123132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936708.123710:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503108224 00000100:00100000:3.0:1784936708.123728:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503108224 00000100:00100000:3.0:1784936708.123820:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:3.0:1784936708.123834:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8815850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+44:10413:x1871641503108224:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:3.0:1784936708.124313:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8815850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+45:10413:x1871641503108224:12345-192.168.204.1@tcp:35:bash.0 Request processed in 482us (1196us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1784936708.124324:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:3.0:1784936708.229987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.230135:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503108480 00000100:00100000:0.0:1784936708.230150:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503108480 00000100:00100000:0.0:1784936708.230261:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:0.0:1784936708.230274:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+45:10423:x1871641503108480:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936708.230314:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936708.230345:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94da3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936708.230562:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1784936708.230729:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94da3 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.230746:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:0.0:1784936708.230768:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936708.230776:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94da3 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.230794:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ba00, rc 0) 00000100:00100000:0.0:1784936708.230888:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+46:10423:x1871641503108480:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 616us (919us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1784936708.230896:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:0.0:1784936708.235082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936708.235219:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503108608 00000100:00100000:2.0:1784936708.235232:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503108608 00000100:00100000:2.0:1784936708.235316:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:2.0:1784936708.235330:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+46:10423:x1871641503108608:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:2.0:1784936708.235488:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235512:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235549:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235570:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235578:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235585:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235747:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235758:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235765:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936708.235832:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235847:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235855:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235863:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235881:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936708.235886:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235895:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235910:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936708.235914:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936708.235919:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235926:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f5d66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235944:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235951:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235957:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235962:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936708.235965:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235970:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.235989:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d7e59500) 00010000:00010000:2.0:1784936708.235991:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936708.235994:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236000:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236015:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236021:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236027:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236032:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936708.236035:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236041:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236050:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:2.0:1784936708.236052:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936708.236055:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.236061:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936708.236471:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+46:10423:x1871641503108608:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1140us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936708.236480:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:1.0:1784936708.241158:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936708.241305:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503108864 00000100:00100000:3.0:1784936708.241320:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503108864 00000100:00100000:3.0:1784936708.241400:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1784936708.241412:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+46:10423:x1871641503108864:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936708.241935:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+47:10423:x1871641503108864:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 522us (788us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1784936708.241945:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1784936708.314571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.314755:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503109120 00000100:00100000:0.0:1784936708.314769:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503109120 00000100:00100000:0.0:1784936708.314877:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:0.0:1784936708.314891:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+47:10426:x1871641503109120:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936708.314928:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936708.314967:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94daa expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315074:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315092:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315109:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315128:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315135:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315163:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315345:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315355:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315363:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936708.315374:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784936708.315550:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315559:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315566:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315573:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936708.315578:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315586:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315600:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936708.315603:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936708.315617:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315623:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5d82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315639:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315646:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315652:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315658:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936708.315661:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315667:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315675:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096caf90400) 00010000:00010000:0.0:1784936708.315678:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936708.315681:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315687:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f5d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315742:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f5d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94daa expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315770:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94daa expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.315780:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936708.315783:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936708.315785:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26aa00, rc 0) 00000100:00100000:0.0:1784936708.315886:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+49:10426:x1871641503109120:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 996us (1329us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1784936708.315895:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:0.0:1784936708.327533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.327593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936708.327617:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503109376 00000100:00100000:2.0:1784936708.327632:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503109376 00000100:00100000:1.0:1784936708.327786:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503109248 00000100:00100000:1.0:1784936708.327792:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503109248 00000100:00100000:1.0:1784936708.327858:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:1.0:1784936708.327881:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+50:10426:x1871641503109248:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:1.0:1784936708.327993:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328016:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328031:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328068:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328075:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328083:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328125:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936708.328130:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328139:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328155:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:1.0:1784936708.328159:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936708.328170:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.328186:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936708.328300:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+50:10426:x1871641503109248:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 431us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936708.328308:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:2.0:1784936708.329757:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1784936708.329779:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+49:2372:x1871641503109376:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936708.329802:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936708.329842:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94daa expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936708.329863:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:2.0:1784936708.329878:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936708.329944:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+48:2372:x1871641503109376:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 173us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936708.329953:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1784936708.335014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936708.335327:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503109632 00000100:00100000:3.0:1784936708.335341:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503109632 00000100:00100000:3.0:1784936708.335420:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:3.0:1784936708.335475:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+48:10426:x1871641503109632:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936708.336307:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+49:10426:x1871641503109632:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 829us (1300us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1784936708.336319:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000040:00080000:0.0:1784936708.362370:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784936708.425065:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936708.550991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.551167:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503109888 00000100:00100000:0.0:1784936708.551189:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503109888 00000100:00100000:0.0:1784936708.551283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:0.0:1784936708.551295:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+49:10444:x1871641503109888:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:0.0:1784936708.551336:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936708.551366:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5da5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94db1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.551545:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5dac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.551564:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.551604:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936708.551618:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784936708.552036:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94db1 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.552063:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94db1 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.552074:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936708.552077:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784936708.552082:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b400, rc 0) 00000100:00100000:0.0:1784936708.552974:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+51:10444:x1871641503109888:12345-192.168.204.1@tcp:101:cat.0 Request processed in 1670us (1989us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1784936708.552987:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:0.0:1784936708.599589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936708.599702:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503110016 00000100:00100000:1.0:1784936708.599715:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503110016 00000100:00100000:1.0:1784936708.599794:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:1.0:1784936708.599889:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+51:10445:x1871641503110016:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936708.599924:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936708.599955:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94db8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.600054:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.600089:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.600104:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936708.600190:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1784936708.600195:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936708.600224:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.600257:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94db8 expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.600280:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94db8 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.600290:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936708.600294:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936708.600298:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:1.0:1784936708.600389:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10445:x1871641503110016:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 505us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936708.600397:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:3.0:1784936708.606841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936708.607207:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503110400 00000100:00100000:1.0:1784936708.607220:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503110400 00000100:00100000:1.0:1784936708.607297:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:1.0:1784936708.607311:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10445:x1871641503110400:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1784936708.607889:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+53:10445:x1871641503110400:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 578us (1060us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784936708.607917:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1784936708.617580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936708.617718:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503110528 00000100:00100000:0.0:1784936708.617731:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503110528 00000100:00100000:0.0:1784936708.617924:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1784936708.617938:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+53:10445:x1871641503110528:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:0.0:1784936708.617964:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784936708.618000:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5d51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d9c expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.618030:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94db1 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.618074:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f5c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d5d expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936708.618088:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a700) 00010000:00010000:0.0:1784936708.618503:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936708.618603:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+50:10445:x1871641503110528:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 665us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936708.618614:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:0.0:1784936708.627052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936708.627970:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503110656 00000100:00100000:1.0:1784936708.627988:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503110656 00000100:00100000:1.0:1784936708.628077:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:1.0:1784936708.628098:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+50:10445:x1871641503110656:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:1.0:1784936708.628497:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.628522:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.628538:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784936708.629045:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784936708.630474:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1784936708.630580:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1784936708.630770:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+50:10445:x1871641503110656:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 2674us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936708.630785:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:2.0:1784936708.664424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936708.664648:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503110784 00000100:00100000:1.0:1784936708.664676:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503110784 00000100:00100000:1.0:1784936708.664936:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:1.0:1784936708.664954:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+50:10447:x1871641503110784:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936708.664983:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936708.665012:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f5dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94dbf expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665146:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665164:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665284:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665304:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665312:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665318:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665501:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665512:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665519:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936708.665565:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784936708.665570:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936708.665596:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665623:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665633:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665640:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665648:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665655:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936708.665797:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665879:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665895:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936708.665899:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936708.665904:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665910:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5dd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665927:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665933:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665946:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665951:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936708.665955:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665961:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665969:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096c7246800) 00010000:00010000:1.0:1784936708.665972:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936708.665975:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.665980:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.666023:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f5dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.666040:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936708.666048:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:1.0:1784936708.666050:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936708.666053:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165e00, rc 0) 00000100:00100000:1.0:1784936708.666374:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+51:10447:x1871641503110784:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1423us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936708.666393:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00000040:00080000:2.0:1784936709.391669:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936709.391681:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784936709.391737:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784936709.391745:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784936709.391924:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7c6a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524107520:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784936709.392053:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a840 going to sleep for 11 seconds 00000100:00100000:2.0:1784936709.402696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936709.402772:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503110912 00000100:00100000:2.0:1784936709.402793:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503110912 00000100:00100000:2.0:1784936709.402876:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:2.0:1784936709.402889:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503110912:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784936709.402999:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503110912:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936709.403008:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:0.0:1784936709.403445:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7c6a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524107520:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1784936709.405945:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936709.410181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936709.410248:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503111040 00000100:00100000:3.0:1784936709.410262:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503111040 00000100:00100000:3.0:1784936709.410619:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:3.0:1784936709.410634:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+51:10458:x1871641503111040:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784936709.410688:0:6621:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784936709.410840:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+51:10458:x1871641503111040:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 209us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936709.410849:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:2.0:1784936709.420030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.420327:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503111168 00000100:00100000:0.0:1784936709.420341:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503111168 00000100:00100000:0.0:1784936709.420416:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:0.0:1784936709.420468:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+51:10458:x1871641503111168:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.420844:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.420868:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.420885:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430405:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430456:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430472:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430518:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430527:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430533:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936709.430591:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784936709.430597:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936709.430614:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430630:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430639:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430647:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430667:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936709.430672:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430681:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430697:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:1.0:1784936709.430700:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936709.430707:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430714:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5deb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430727:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430734:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430741:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430746:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936709.430751:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430758:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430779:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9096caf90900) 00010000:00010000:1.0:1784936709.430783:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936709.430798:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430805:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5df2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430827:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430834:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430841:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430848:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936709.430850:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430856:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430864:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:1.0:1784936709.430867:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936709.430871:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.430878:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f5df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.432076:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+51:10458:x1871641503111168:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 11635us (12045us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936709.432096:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:3.0:1784936709.443117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.443226:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503111424 00000100:00100000:0.0:1784936709.443238:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503111424 00000100:00100000:0.0:1784936709.443299:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:0.0:1784936709.443310:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+51:10458:x1871641503111424:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.443333:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936709.443357:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5e00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94dc6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443482:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443499:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443511:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936709.443522:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784936709.443628:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443636:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443643:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443649:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936709.443653:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443660:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443687:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:0.0:1784936709.443690:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784936709.443695:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443702:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443746:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5e00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dc6 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443757:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:0.0:1784936709.443759:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936709.443763:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5e00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dc6 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.443772:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b800, rc 0) 00000100:00100000:0.0:1784936709.443848:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503111424:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 540us (741us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1784936709.443856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:1.0:1784936709.450819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.450905:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503111552 00000100:00100000:0.0:1784936709.450923:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503111552 00000100:00100000:0.0:1784936709.451001:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:0.0:1784936709.451016:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503111552:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784936709.451055:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784936709.451177:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503111552:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 165us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936709.451205:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 71 00010000:00010000:3.0:1784936709.453868:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936709.473457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.473520:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503111808 00000100:00100000:0.0:1784936709.473536:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503111808 00000100:00100000:0.0:1784936709.473630:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:0.0:1784936709.473642:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503111808:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.473665:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936709.473669:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784936709.473701:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f5dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94db8 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.473722:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936709.473727:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936709.473894:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5e15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94dcd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784936709.474356:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1784936709.491620:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.491652:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.491668:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.491768:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f5e15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dcd expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.491806:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dcd expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.491816:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096c7246500) 00010000:00010000:1.0:1784936709.491819:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936709.491823:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165a00, rc 0) 00000100:00100000:1.0:1784936709.491914:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+53:10458:x1871641503111808:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 18273us (18493us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1784936709.491924:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:1.0:1784936709.503391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936709.503510:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503112064 00000100:00100000:2.0:1784936709.503527:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503112064 00000100:00100000:2.0:1784936709.503606:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:2.0:1784936709.503618:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+53:10458:x1871641503112064:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784936709.503677:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936709.503706:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f5e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dcd expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503727:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096c7246500) 00010000:00010000:2.0:1784936709.503739:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936709.503765:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503779:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503801:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503859:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503883:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503891:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503979:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503986:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503993:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.503999:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936709.504003:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504011:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504019:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936709.504022:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936709.504026:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504031:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5e2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504041:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504052:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504058:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504063:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936709.504065:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504070:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504077:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x87167d9d (ffff9096d7e59500) 00010000:00010000:2.0:1784936709.504081:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936709.504083:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.504089:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x87167d9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936709.504201:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503112064:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 585us (824us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784936709.504208:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:2.0:1784936709.511669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936709.511715:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503112192 00000100:00100000:2.0:1784936709.511724:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503112192 00000100:00100000:2.0:1784936709.511780:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:2.0:1784936709.511803:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+52:10458:x1871641503112192:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936709.511840:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936709.511869:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5e38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94dd4 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.511911:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.511927:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.511940:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.512051:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 54 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.512071:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 53 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.512081:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:2.0:1784936709.512085:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784936709.512089:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19e00, rc 0) 00000100:00100000:2.0:1784936709.512156:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+53:10458:x1871641503112192:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 355us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936709.512163:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:3.0:1784936709.527608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936709.529348:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503112448 00000100:00100000:2.0:1784936709.529365:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503112448 00000100:00100000:2.0:1784936709.529494:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:2.0:1784936709.529507:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+53:10458:x1871641503112448:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784936709.529747:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.529774:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.529801:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784936709.530204:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1784936709.530216:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375281787067ns, next at 376281784559ns, rc = 0 00000004:00010000:3.0:1784936709.530371:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b91ce956 reply state 000000001cd007d0 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936709.530382:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784936709.530574:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+55:10458:x1871641503112448:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1065us (2978us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1784936709.530584:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00010000:00010000:0.0:1784936709.538025:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936709.538050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:0.0:1784936709.538060:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.538081:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.538091:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936709.538099:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.538139:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.538167:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936709.538171:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784936709.538177:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.538183:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4600/0x6cf7a864723f5e46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936709.538275:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503112576 00000100:00100000:3.0:1784936709.538287:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503112576 00000100:00100000:3.0:1784936709.538369:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:3.0:1784936709.538381:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+54:10458:x1871641503112576:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784936709.538425:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936709.538502:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ddb expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.538584:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 55 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.538604:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 55 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.538641:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:3.0:1784936709.538644:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784936709.538647:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4c00, rc 0) 00000100:00100000:3.0:1784936709.538734:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+55:10458:x1871641503112576:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 355us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936709.538743:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:2.0:1784936709.552793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936709.552945:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503112704 00000100:00100000:1.0:1784936709.552963:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503112704 00000100:00100000:1.0:1784936709.553030:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:1.0:1784936709.553039:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1871641503112704:12345-192.168.204.1@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1784936709.553086:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:1.0:1784936709.553125:0:6595:0:(genops.c:1406:class_connect()) connect: client 486efceb-7a20-41d5-8389-4305380725bf, cookie 0x6cf7a864723f5e54 00002000:00100000:1.0:1784936709.553138:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 486efceb-7a20-41d5-8389-4305380725bf/ffff9096c8bc4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784936709.553161:0:6595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784936709.553482:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784936709.553518:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9096c8bc7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936709.553597:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2370:x1871641503112704:12345-192.168.204.1@tcp:8:lhsmtool_posix.0 Request processed in 557us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936709.553605:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:1.0:1784936709.573270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936709.573406:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503112832 00000100:00100000:3.0:1784936709.573481:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503112832 00000100:00100000:3.0:1784936709.573564:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:3.0:1784936709.573576:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:0:x1871641503112832:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1784936709.573899:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1784936709.664464:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000001:00080000:1.0:1784936709.664490:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1784936709.664829:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:0:x1871641503112832:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 91249us (91567us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784936709.664839:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:2.0:1784936709.669689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936709.672145:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503113088 00000100:00100000:1.0:1784936709.672240:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503113088 00000100:00100000:1.0:1784936709.672404:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:1.0:1784936709.672419:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+55:10458:x1871641503113088:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784936709.677016:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+56:10458:x1871641503113088:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 2127us (4869us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784936709.677036:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:3.0:1784936709.695757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936709.695895:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503113344 00000100:00100000:1.0:1784936709.695911:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503113344 00000100:00100000:1.0:1784936709.696003:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:1.0:1784936709.696017:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+56:10458:x1871641503113344:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784936709.696285:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+56:10458:x1871641503113344:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 270us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936709.696305:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:1.0:1784936709.706860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.707070:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503113472 00000100:00100000:0.0:1784936709.707086:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503113472 00000100:00100000:0.0:1784936709.707189:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:0.0:1784936709.707203:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+56:10458:x1871641503113472:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.707234:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936709.707267:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94de2 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.707388:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.707407:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.707423:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936709.707512:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936709.707540:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.707579:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de2 expref: 58 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.707598:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de2 expref: 57 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.707608:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936709.707612:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784936709.707617:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b400, rc 0) 00000100:00100000:0.0:1784936709.707698:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+57:10458:x1871641503113472:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 498us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936709.707707:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:2.0:1784936709.715886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936709.716511:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503113600 00000100:00100000:3.0:1784936709.716534:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503113600 00000100:00100000:3.0:1784936709.716612:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:3.0:1784936709.716623:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503113600:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784936709.716651:0:6595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936709.716680:0:6595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94de9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936709.716724:0:6595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f905, blocks: 0x1 00010000:00010000:3.0:1784936709.716749:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1784936709.716754:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936709.716765:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 6 pid: 6595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.716800:0:6595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 6 pid: 6595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936709.716816:0:6595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5c00, rc 0) 00000100:00100000:3.0:1784936709.716904:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503113600:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 282us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936709.716925:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:0.0:1784936709.739004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936709.739467:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503113856 00000100:00100000:3.0:1784936709.739482:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503113856 00000100:00100000:0.0:1784936709.739880:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:0.0:1784936709.739894:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+57:10458:x1871641503113856:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784936709.740050:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+57:10458:x1871641503113856:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 159us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936709.740058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:2.0:1784936709.750702:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.750818:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503113984 00000100:00100000:0.0:1784936709.750833:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503113984 00000100:00100000:0.0:1784936709.750906:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:0.0:1784936709.750988:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:10458:x1871641503113984:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.751020:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936709.751049:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94df0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.751133:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 7 pid: 6595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.751810:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936709.751816:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936709.751823:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.751876:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 7 pid: 6595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.751897:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 7 pid: 6595 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.751914:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6598:1871641524107648:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936709.752045:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c93726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936709.760669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936709.760723:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503114112 00000100:00100000:2.0:1784936709.760735:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503114112 00010000:00010000:2.0:1784936709.760801:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 8 pid: 6595 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936709.760851:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:2.0:1784936709.760863:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d464ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503114112:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936709.760885:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936709.760919:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 8 pid: 6595 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.760939:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 8 pid: 6595 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.760981:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936709.760987:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936709.761000:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.761013:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.761068:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936709.761086:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7c6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1871641524107776:192.168.204.1@tcp:105: 00000100:00100000:2.0:1784936709.761188:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a840 going to sleep for 11 seconds 00010000:00010000:0.0:1784936709.762421:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7deb126/0x6cf7a864723f5e69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de9 expref: 8 pid: 6595 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.762466:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6598:1871641524107648:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936709.762502:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.762516:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a000, rc 0) 00000100:00100000:0.0:1784936709.762606:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:10458:x1871641503113984:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 11625us (11923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936709.762616:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:2.0:1784936709.771129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.771220:0:6603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503114240 00000100:00100000:0.0:1784936709.771233:0:6603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503114240 00002000:00100000:0.0:1784936709.771296:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9096c7c68700 x1871641503114240/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:450/0 lens 504/0 e 0 to 0 dl 1784936720 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936709.771309:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096c7c68700 with x1871641503114240 ext(0->8) 00002000:00010000:0.0:1784936709.771321:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096c7c68700 00000100:00100000:0.0:1784936709.771365:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1784936709.771377:0:6603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503114240:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784936709.774054:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7c6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1871641524107776:192.168.204.1@tcp:105: 00000100:00100000:0.0:1784936709.774056:0:6603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503114240:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 2667us (2930us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784936709.774083:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00002000:00100000:0.0:1784936709.774098:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9096c7c68700 x1871641503114240/t4294967302(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:450/0 lens 504/448 e 0 to 0 dl 1784936720 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1784936709.774102:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1784936709.774114:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096c7c68700 with x1871641503114240 ext(0->8) 00002000:00010000:0.0:1784936709.774122:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096c7c68700 00000100:00100000:3.0:1784936709.774180:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d464ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503114112:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 13317us (13531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936709.774193:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:2.0:1784936709.796920:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936709.800903:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503114368 00000100:00100000:1.0:1784936709.800927:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503114368 00000100:00100000:1.0:1784936709.801026:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:1.0:1784936709.801134:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+57:10458:x1871641503114368:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000040:00080000:3.0:1784936709.860105:0:11870:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936709.860119:0:11870:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936709.860179:0:11870:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784936709.860186:0:11870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784936709.877798:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+57:10458:x1871641503114368:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 76738us (80879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936709.877813:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00000001:00080000:2.0:1784936709.877852:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:2.0:1784936709.877891:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1784936709.878058:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784936709.878085:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096ff9270c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784936709.878090:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096ef152b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096ff927a80 00000020:00080000:2.0:1784936709.878093:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096ef152300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096ff513800 00000004:00080000:2.0:1784936709.878109:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:3.0:1784936709.878504:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524107904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784936709.878562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784936709.880115:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1784936709.880265:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1784936709.880375:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524108032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784936709.880448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936709.880503:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524107904 00000100:00100000:2.0:1784936709.880511:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524107904 00000100:00100000:2.0:1784936709.880566:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524108032 00000100:00100000:2.0:1784936709.880574:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524108032 00000100:00100000:2.0:1784936709.880607:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784936709.880615:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1871641524107904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784936709.880643:0:8072:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1784936709.880680:0:8072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a63f901, atime: 0x6a63f901, ctime: 0x6a63f901, blocks: 0x1 00010000:00010000:2.0:1784936709.880689:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.880706:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1784936709.880711:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936709.880718:0:8072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.880738:0:8072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.880750:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.880759:0:8072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.880790:0:8072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784936709.883335:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1871641524107904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2715us (4768us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784936709.883348:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784936709.883384:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784936709.883403:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524108032:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1784936709.883978:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936709.883986:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784936709.884112:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9095c1eadc00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1784936709.884120:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524107904:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1784936709.884315:0:8072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784936709.884319:0:8072:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784936709 00002000:00010000:2.0:1784936709.884322:0:8072:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784936709.884324:0:8072:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784936709 -> 1784936709 00002000:00010000:2.0:1784936709.884327:0:8072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784936709.884381:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1871641524108032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 981us (3933us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784936709.884388:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1784936709.884421:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936709.884449:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.884461:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936709.884467:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.884479:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.884501:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.884509:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000504bb09e/0x6cf7a864723f5e77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.884526:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936709.884538:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936709.884540:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936709.884629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936709.884653:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503114496 00000100:00100000:2.0:1784936709.884660:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503114496 00000100:00100000:2.0:1784936709.884692:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:2.0:1784936709.884700:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503114496:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1784936709.886012:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096c7c6aa00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1784936709.886024:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7c6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524108032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784936709.924510:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503114496:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 39798us (39871us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936709.924523:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00000001:00080000:2.0:1784936709.924563:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1784936709.924582:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1784936709.929519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.930703:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503114752 00000100:00100000:0.0:1784936709.930716:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503114752 00000100:00100000:0.0:1784936709.930840:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:0.0:1784936709.930853:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+13:10458:x1871641503114752:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.930920:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936709.930952:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f5e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94de2 expref: 13 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.930984:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936709.930990:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936709.931027:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.931043:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.931054:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936709.931451:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000def44fe8 reply state 0000000013601237 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.931462:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936709.931580:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+14:10458:x1871641503114752:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 729us (2071us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1784936709.931588:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:2.0:1784936709.934811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:0.0:1784936709.935070:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.935086:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.935095:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.935103:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936709.935109:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936709.935124:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503114880 00010000:00010000:0.0:1784936709.935127:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936709.935147:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503114880 00010000:00010000:0.0:1784936709.935201:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936709.935205:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936709.935213:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936709.935224:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1784936709.935235:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503114880:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.935286:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936709.935529:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784936709.935539:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784936709 -> 1784936708 00002000:00010000:3.0:1784936709.935700:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784936705 00002000:00010000:3.0:1784936709.935704:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784936709 -> 1784936708 00002000:00010000:3.0:1784936709.935706:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784936709.935770:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503114880:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 536us (967us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784936709.935786:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:2.0:1784936709.953537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936709.953581:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503115136 00000100:00100000:0.0:1784936709.953591:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503115136 00000100:00100000:0.0:1784936709.953677:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:0.0:1784936709.953687:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+13:10458:x1871641503115136:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784936709.953769:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.953797:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 13 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.953807:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.953841:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 13 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.953860:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 13 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.953888:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524108160:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936709.953980:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3780 going to sleep for 11 seconds 00000100:00100000:2.0:1784936709.969797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936709.970077:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524108160:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936709.970105:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.970574:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503115264 00000100:00100000:0.0:1784936709.970583:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503115264 00010000:00010000:0.0:1784936709.970619:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936709.970657:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:0.0:1784936709.970669:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+14:2371:x1871641503115264:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936709.970685:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936709.970692:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.970708:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.970731:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dd4 expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.970746:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936709.970751:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.970761:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.970793:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936709.970826:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936709.970882:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+13:2371:x1871641503115264:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 214us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936709.970890:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00010000:00010000:2.0:1784936709.973269:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973286:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973328:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973337:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973343:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973361:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936709.973366:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973373:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973390:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:2.0:1784936709.973392:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784936709.973397:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936709.973404:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5e85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936709.973519:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+12:10458:x1871641503115136:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 19829us (19986us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784936709.973529:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:0.0:1784936709.987570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936709.987738:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503115392 00000100:00100000:1.0:1784936709.987749:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503115392 00000100:00100000:1.0:1784936709.987821:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:1.0:1784936709.987833:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:2373:x1871641503115392:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784936709.987890:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.987916:0:8072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.987928:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936709.987933:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784936709.987938:0:8072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.987978:0:8072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936709.987994:0:8072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 7 pid: 6598 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936709.988029:0:8072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8072:1871641524108288:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936709.988119:0:8072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936710.011541:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936710.011555:0:8072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8072:1871641524108288:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936710.011586:0:8072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936710.012676:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503115520 00000100:00100000:3.0:1784936710.012686:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503115520 00010000:00010000:3.0:1784936710.012726:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936710.012785:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:3.0:1784936710.012796:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503115520:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936710.012826:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936710.012852:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.012870:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.012897:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000296de03f/0x6cf7a864723f5e70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df0 expref: 8 pid: 6598 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.012928:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936710.012932:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936710.012938:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.012948:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.012974:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936710.013035:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503115520:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 240us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936710.013044:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00010000:00010000:2.0:1784936710.013205:0:8072:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013215:0:8072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013239:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013259:0:8072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013266:0:8072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013272:0:8072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936710.013277:0:8072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013286:0:8072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013297:0:8072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.013304:0:8072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfb0fdd6/0x6cf7a864723f5e8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936710.013377:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503115392:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 25547us (25816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936710.013385:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:0.0:1784936710.020407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936710.020743:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503115776 00000100:00100000:0.0:1784936710.020753:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503115776 00000100:00100000:0.0:1784936710.021250:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:0.0:1784936710.021263:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+12:10458:x1871641503115776:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784936710.021693:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.021714:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.021728:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.022075:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.022089:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 13 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.022097:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.022148:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 13 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.022165:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 13 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936710.022180:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524108416:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936710.022353:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936710.032105:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524108544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936710.032175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936710.032290:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524108544 00000100:00100000:0.0:1784936710.032299:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524108544 00000100:00100000:0.0:1784936710.032361:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784936710.032372:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524108544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936710.032398:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1784936710.033624:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524108544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1248us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936710.033634:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784936710.036738:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1784936710.036751:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096c7c6aa00, transno 4294967303 00000100:00100000:2.0:1784936710.036838:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524108544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936710.041184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936710.041303:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524108416:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936710.041330:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936710.041573:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503115904 00000100:00100000:3.0:1784936710.041581:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503115904 00010000:00010000:3.0:1784936710.041621:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936710.041664:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:3.0:1784936710.041673:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+14:2372:x1871641503115904:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936710.041689:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936710.041697:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.041712:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.041749:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ddb expref: 14 pid: 6621 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.041762:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:3.0:1784936710.041768:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.041787:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.041794:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936710.041815:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936710.041865:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+13:2372:x1871641503115904:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 192us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936710.041872:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00010000:00010000:2.0:1784936710.041932:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936710.041942:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936710.042115:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1784936710.042272:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1784936710.042320:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1784936710.042543:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1871641524108672:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784936710.042603:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936710.042634:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784936710.042735:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524108672 00000100:00100000:3.0:1784936710.042741:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524108672 00000100:00100000:3.0:1784936710.042795:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936710.042804:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1871641524108672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784936710.042879:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1871641524108672:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936710.042885:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784936710.043469:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1871641524108672:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1784936710.043944:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1784936710.044010:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1871641524108800:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784936710.044059:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936710.044083:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff49a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936710.044150:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524108800 00000100:00100000:3.0:1784936710.044227:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524108800 00000100:00100000:3.0:1784936710.044266:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936710.044274:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1871641524108800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784936710.044476:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1871641524108800:12345-0@lo:1000:mdt00_001.0 Request processed in 201us (414us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784936710.044483:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784936710.044569:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1871641524108800:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784936710.044605:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044614:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044621:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044637:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936710.044642:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044650:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044666:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936710.044669:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936710.044674:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044680:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f5e9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044722:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044729:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044734:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044739:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936710.044742:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044747:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044764:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:0.0:1784936710.044766:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936710.044769:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044786:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5dc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044810:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044823:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044831:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044858:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.044874:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 16 pid: 5797 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936710.044885:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524108928:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936710.044953:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3600 going to sleep for 11 seconds 00000100:00100000:0.0:1784936710.060616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936710.060656:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503116032 00000100:00100000:0.0:1784936710.060666:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503116032 00010000:00010000:0.0:1784936710.060711:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 17 pid: 5797 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936710.060758:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:0.0:1784936710.060769:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+17:2372:x1871641503116032:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936710.060798:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936710.060806:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 17 pid: 5797 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.060822:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 17 pid: 5797 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.060845:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:0.0:1784936710.060851:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.060862:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.060870:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.060891:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936710.060946:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+17:2372:x1871641503116032:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 178us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936710.060954:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00010000:00010000:0.0:1784936710.061097:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dbf expref: 16 pid: 5797 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936710.061112:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524108928:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936710.061141:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061151:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061157:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061171:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061178:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061185:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061190:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936710.061195:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061202:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061212:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:0.0:1784936710.061214:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936710.061218:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061223:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f5ea1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061246:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061622:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061629:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061634:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ba00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936710.061637:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061643:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061653:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096c7246400) 00010000:00010000:0.0:1784936710.061655:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784936710.061658:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.061664:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5e93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936710.061910:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:10458:x1871641503115776:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 40648us (41513us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1784936710.061921:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 83 00000020:00080000:0.0:1784936710.061926:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784936710.062074:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784936710.062080:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784936710.062121:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784936710.062127:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784936710.080272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936710.080327:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503116288 00000100:00100000:0.0:1784936710.080336:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503116288 00000100:00100000:0.0:1784936710.080393:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:0.0:1784936710.080402:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+15:10458:x1871641503116288:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784936710.081187:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784936710.081314:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1784936710.081367:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081384:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081397:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081406:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081413:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081419:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081466:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784936710.081570:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+17:10458:x1871641503116288:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1167us (1322us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1784936710.081579:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000020:00080000:0.0:1784936710.081592:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784936710.081626:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936710.081632:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081640:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936710.081644:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081652:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081664:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9096caf90800) 00010000:00010000:0.0:1784936710.081667:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784936710.081672:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081678:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5ea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936710.081695:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936710.081697:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936710.081698:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936710.472638:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784936711.136010:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1784936711.136050:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1784936711.496611:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936711.560944:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936711.560980:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524109056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936711.561083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936711.561343:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524109056 00000100:00100000:3.0:1784936711.561355:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524109056 00000100:00100000:1.0:1784936711.561371:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524109312:0@lo:400:kworker.0 00000100:00100000:3.0:1784936711.561482:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784936711.561485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936711.561493:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524109056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936711.561511:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784936711.561517:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524109184:0@lo:400:kworker.0 00002000:00000024:3.0:1784936711.561542:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936711.561547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936711.561570:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524109696:0@lo:400:kworker.0 00000100:00100000:3.0:1784936711.561592:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524109056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936711.561592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936711.561600:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784936711.561622:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524109312 00000100:00080000:3.0:1784936711.561624:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936711.561626:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524109312 00000100:00100000:1.0:1784936711.561670:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524109696 00000100:00100000:1.0:1784936711.561673:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524109696 00000100:00100000:3.0:1784936711.561757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784936711.561766:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524109312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936711.561812:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524109312:12345-0@lo:400:kworker.0 Request processed in 47us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936711.561879:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784936711.561887:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524109696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.561920:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524109696:12345-0@lo:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936711.561927:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784936711.561950:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524109184 00000100:00100000:1.0:1784936711.561954:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524109184 00000100:00100000:1.0:1784936711.561994:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1784936711.562000:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524109184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936711.562002:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784936711.562032:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524109184:12345-0@lo:400:kworker.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936711.562039:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784936711.562077:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524109568:0@lo:400:kworker.0 00000100:00100000:2.0:1784936711.562116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784936711.562147:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936711.562149:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936711.562163:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524109440:0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.562181:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524109184:0@lo:400:kworker.0 00000100:00100000:2.0:1784936711.562189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936711.562198:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524109696:0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.562208:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524109312:0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.562235:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524109440 00000100:00100000:1.0:1784936711.562238:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524109440 00000100:00100000:3.0:1784936711.562267:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524109568 00000100:00100000:3.0:1784936711.562271:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524109568 00000100:00100000:1.0:1784936711.562276:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784936711.562281:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524109440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936711.562299:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784936711.562305:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524109568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.562313:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524109440:12345-0@lo:400:kworker.0 Request processed in 32us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936711.562319:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784936711.562334:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524109568:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936711.562340:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784936711.562344:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524109440:0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.562355:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524109568:0@lo:400:kworker.0 00000100:00100000:1.0:1784936711.562383:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1784936711.562390:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000100:00080000:2.0:1784936711.562403:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936711.562406:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1784936711.562408:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9095c1eadc00, transno 4294967301 00000100:00100000:1.0:1784936711.562628:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524109056:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1784936711.850021:0:11922:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936711.850036:0:11922:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784936711.850227:0:11922:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784936711.850235:0:11922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784936712.037611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936712.037807:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503116544 00000100:00100000:2.0:1784936712.037823:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503116544 00000100:00100000:2.0:1784936712.037924:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:2.0:1784936712.037936:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+17:10477:x1871641503116544:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936712.037971:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936712.038003:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5eaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94df7 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784936712.038101:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784936712.038375:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5eb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.038393:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.038408:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936712.038423:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1784936712.038672:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5eaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df7 expref: 20 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.038690:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df7 expref: 19 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.038707:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936712.038711:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784936712.038717:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19400, rc 0) 00000100:00100000:2.0:1784936712.038824:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+19:10477:x1871641503116544:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 889us (1232us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1784936712.038834:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1784936712.046465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936712.048375:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503116672 00000100:00100000:2.0:1784936712.048406:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503116672 00000100:00100000:2.0:1784936712.048525:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:2.0:1784936712.048539:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+19:10477:x1871641503116672:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:2.0:1784936712.048658:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.048683:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.048701:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.048720:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.048729:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.049016:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052144:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052182:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052198:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936712.052281:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052298:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052307:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052314:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052322:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.052326:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052336:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052352:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936712.052356:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.052362:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052369:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052406:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052413:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052420:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052630:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.052634:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052641:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052650:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d7e59b00) 00010000:00010000:2.0:1784936712.052653:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.052656:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052662:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052688:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052694:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052700:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052712:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.052716:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052722:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052730:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d7e59500) 00010000:00010000:2.0:1784936712.052741:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.052745:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.052751:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f5ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936712.052888:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+19:10477:x1871641503116672:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 4345us (6456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936712.052899:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:3.0:1784936712.125588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.125641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.125685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.125756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.125798:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503117056 00000100:00100000:3.0:1784936712.125812:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503117056 00000100:00100000:3.0:1784936712.125888:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503116928 00000100:00100000:3.0:1784936712.125891:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503116928 00000100:00100000:3.0:1784936712.125918:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:3.0:1784936712.125929:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503117056:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936712.126032:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503117056:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 104us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936712.126040:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:3.0:1784936712.126059:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:3.0:1784936712.126065:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503116928:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936712.126090:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503116928:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936712.126096:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:3.0:1784936712.126133:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503117184 00000100:00100000:3.0:1784936712.126137:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503117184 00000100:00100000:3.0:1784936712.126173:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00100000:3.0:1784936712.126179:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503117184:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936712.126463:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503116800 00000100:00100000:0.0:1784936712.126469:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503116800 00000100:00100000:0.0:1784936712.126509:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 288 00000100:00100000:0.0:1784936712.126529:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503116800:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936712.126599:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503117184:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 417us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936712.126606:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00080000:3.0:1784936712.126637:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784936712.126644:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936712.126647:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936712.134301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.134490:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503117440 00000100:00100000:3.0:1784936712.134505:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503117440 00000100:00100000:3.0:1784936712.134587:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:3.0:1784936712.134599:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+19:10480:x1871641503117440:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936712.134627:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936712.134656:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94dfe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936712.134796:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503116800:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 8265us (9222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936712.134810:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 288 00010000:00010000:3.0:1784936712.135320:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.135341:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.135357:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.135376:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.135384:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.135506:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.136303:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.136326:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.136336:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936712.136350:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784936712.137597:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137613:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137621:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137628:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936712.137634:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137643:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137807:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:3.0:1784936712.137812:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936712.137819:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137827:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137847:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137863:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137869:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137875:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936712.137878:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137884:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137892:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d173a700) 00010000:00010000:3.0:1784936712.137895:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936712.137897:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137904:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f5ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137982:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5ed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.137998:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.138007:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:3.0:1784936712.138010:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936712.138017:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4a00, rc 0) 00000100:00100000:3.0:1784936712.138168:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+21:10480:x1871641503117440:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 3518us (3835us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1784936712.138180:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:0.0:1784936712.154602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936712.155860:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503117568 00000100:00100000:1.0:1784936712.155892:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503117568 00000100:00100000:1.0:1784936712.155972:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:1.0:1784936712.155985:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+21:10480:x1871641503117568:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:1.0:1784936712.156095:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156599:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156620:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156792:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156802:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156811:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156819:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936712.156824:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.156832:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.157190:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:1.0:1784936712.157195:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936712.157201:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.157225:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5efc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936712.159222:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+21:10480:x1871641503117568:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 3222us (4776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936712.159239:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:1.0:1784936712.174697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936712.174817:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503117824 00000100:00100000:0.0:1784936712.174833:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503117824 00000100:00100000:0.0:1784936712.174951:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1784936712.174967:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8816450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+21:10480:x1871641503117824:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936712.175539:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8816450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+22:10480:x1871641503117824:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 575us (854us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784936712.175549:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:0.0:1784936712.230343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936712.230582:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118080 00000100:00100000:1.0:1784936712.230597:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118080 00000100:00100000:1.0:1784936712.230821:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:1.0:1784936712.230836:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+22:10000:x1871641503118080:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936712.230945:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936712.230978:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5f03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.231344:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.231365:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.231374:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.231420:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.232595:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 23 pid: 5798 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936712.232646:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524109824:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936712.233339:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1784936712.239318:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524109824:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936712.239369:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936712.243296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936712.243615:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118208 00000100:00100000:0.0:1784936712.243630:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118208 00010000:00010000:0.0:1784936712.243697:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 24 pid: 5798 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936712.243915:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:0.0:1784936712.243927:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+24:2372:x1871641503118208:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936712.243952:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936712.243962:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 24 pid: 5798 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.243982:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 24 pid: 5798 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.244269:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94dfe expref: 24 pid: 5798 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.244292:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:0.0:1784936712.244299:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.244310:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.244319:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.244546:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.244556:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.244560:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1784936712.244599:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:0.0:1784936712.244668:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+23:2372:x1871641503118208:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 742us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936712.244679:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00010000:00010000:2.0:1784936712.245592:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f5f03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.245624:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.245634:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:2.0:1784936712.245637:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784936712.245640:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164a00, rc 0) 00000100:00100000:2.0:1784936712.246653:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+23:10000:x1871641503118080:12345-192.168.204.1@tcp:101:bash.0 Request processed in 15812us (16318us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784936712.246790:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:2.0:1784936712.254608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936712.254806:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118464 00000100:00100000:1.0:1784936712.254822:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118464 00000100:00100000:1.0:1784936712.254929:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 89 00000100:00100000:1.0:1784936712.254944:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+23:10000:x1871641503118464:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:1.0:1784936712.255406:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.255464:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.255483:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936712.255557:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1784936712.255588:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082e87fcc reply state 00000000a5d02a16 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936712.255602:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784936712.256461:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1784936712.257879:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:10000:x1871641503118464:12345-192.168.204.1@tcp:36:bash.0 Request processed in 2919us (3269us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1784936712.257895:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 89 00000020:00080000:1.0:1784936712.257907:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1784936712.265994:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936712.266376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:1.0:1784936712.266629:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.266662:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.266671:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936712.266678:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.266688:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.266711:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:1.0:1784936712.266715:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936712.266723:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.266740:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f5f18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936712.266802:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118592 00000100:00100000:2.0:1784936712.266818:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118592 00000100:00100000:2.0:1784936712.266895:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:2.0:1784936712.266907:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+26:10000:x1871641503118592:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936712.266941:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936712.266965:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5f1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e0c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.267287:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5f1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e0c expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.267307:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5f1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e0c expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.267346:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:2.0:1784936712.267350:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784936712.267353:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18600, rc 0) 00000100:00100000:2.0:1784936712.267616:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+27:10000:x1871641503118592:12345-192.168.204.1@tcp:101:bash.0 Request processed in 709us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936712.267624:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:0.0:1784936712.274832:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.274932:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118720 00000100:00100000:3.0:1784936712.274946:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118720 00000100:00100000:3.0:1784936712.275091:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:3.0:1784936712.275104:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:10000:x1871641503118720:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1784936712.275148:0:6595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936712.275180:0:6595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e13 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936712.275343:0:6595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a63f904, atime: 0x6a63f901, ctime: 0x6a63f904, blocks: 0xb 00010000:00010000:3.0:1784936712.275380:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1784936712.275387:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936712.275400:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 7 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.275424:0:6595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 7 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.275548:0:6595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5800, rc 0) 00000100:00100000:3.0:1784936712.275622:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:10000:x1871641503118720:12345-192.168.204.1@tcp:101:bash.0 Request processed in 520us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936712.275631:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:0.0:1784936712.280979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.281126:0:6601:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118848 00000100:00100000:3.0:1784936712.281163:0:6601:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118848 00002000:00010000:3.0:1784936712.281341:0:6601:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1784936712.281348:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fbbd2300 with x1871641503118848 ext(0->18446744073709551615) 00002000:00010000:3.0:1784936712.281365:0:6601:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096fbbd2300. 00000100:00100000:3.0:1784936712.281407:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1784936712.281421:0:6601:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503118848:12345-192.168.204.1@tcp:10:bash.0 00002000:00010000:3.0:1784936712.282014:0:6601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784936712.282019:0:6601:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784936708 -> 1784936712 00002000:00010000:3.0:1784936712.282022:0:6601:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1784936705 -> 1784936705 00002000:00010000:3.0:1784936712.282025:0:6601:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784936708 -> 1784936712 00002000:00010000:3.0:1784936712.282028:0:6601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784936712.282111:0:6601:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503118848:12345-192.168.204.1@tcp:10:bash.0 Request processed in 691us (1147us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784936712.284056:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00002000:00010000:3.0:1784936712.284067:0:6601:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1784936712.284072:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fbbd2300 with x1871641503118848 ext(0->18446744073709551615) 00002000:00010000:3.0:1784936712.284090:0:6601:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096fbbd2300. 00000100:00100000:0.0:1784936712.395718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936712.395954:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503118976 00000100:00100000:2.0:1784936712.395974:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503118976 00000100:00100000:2.0:1784936712.396069:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:2.0:1784936712.396083:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+27:10494:x1871641503118976:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:2.0:1784936712.396550:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.396575:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.396591:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.396610:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.396618:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.396625:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397550:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397574:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397585:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936712.397673:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397690:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397698:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397705:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397713:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.397718:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397736:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397753:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936712.397756:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.397762:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397769:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397791:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397798:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397804:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397809:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.397812:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397819:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397828:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d7e59500) 00010000:00010000:2.0:1784936712.397831:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.397834:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397840:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397866:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397873:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397878:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397890:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.397893:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397900:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397909:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:2.0:1784936712.397912:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.397916:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.397921:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936712.398054:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+27:10494:x1871641503118976:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1968us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936712.398066:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:0.0:1784936712.460587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936712.463633:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503119232 00000100:00100000:2.0:1784936712.463937:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503119232 00000100:00100000:2.0:1784936712.464249:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:2.0:1784936712.464262:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+27:10497:x1871641503119232:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936712.464297:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936712.464330:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e1a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.464475:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.464518:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.464533:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.464552:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.464559:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.464566:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.465814:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f5f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.465833:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f5f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.465845:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f5f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936712.465860:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784936712.466002:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.466012:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467229:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467262:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.467269:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467280:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467303:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936712.467306:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.467312:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467319:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f5f49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467345:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467353:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467359:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467365:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.467368:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467375:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467395:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d7e59500) 00010000:00010000:2.0:1784936712.467398:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.467401:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467409:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f5f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467555:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f5f42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e1a expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467576:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f5f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e1a expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.467585:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:2.0:1784936712.467588:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784936712.467591:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18800, rc 0) 00000100:00100000:2.0:1784936712.467714:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+29:10497:x1871641503119232:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 3453us (7143us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1784936712.467735:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:0.0:1784936712.473009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.473150:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503119360 00000100:00100000:3.0:1784936712.473164:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503119360 00000100:00100000:3.0:1784936712.473287:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:3.0:1784936712.473301:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+29:10497:x1871641503119360:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:3.0:1784936712.473404:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.473466:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.473501:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.473549:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.473571:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 29 pid: 5796 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936712.473590:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ffa64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524109952:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936712.473723:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936712.476295:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ffa64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524109952:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936712.476346:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936712.482925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936712.483236:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503119616 00000100:00100000:1.0:1784936712.483252:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503119616 00000100:00100000:1.0:1784936712.483337:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:1.0:1784936712.483351:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+30:5589:x1871641503119616:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784936712.483923:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+31:5589:x1871641503119616:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 572us (1012us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1784936712.483932:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:1.0:1784936712.491710:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936712.491838:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503119744 00000100:00100000:0.0:1784936712.491851:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503119744 00010000:00010000:0.0:1784936712.491912:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 31 pid: 5796 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936712.491995:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:0.0:1784936712.492008:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+31:2371:x1871641503119744:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936712.492043:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936712.492054:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 31 pid: 5796 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.492074:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 31 pid: 5796 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.492176:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f5f0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e05 expref: 31 pid: 5796 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.492198:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:0.0:1784936712.492205:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.492216:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.492224:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.492263:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936712.492347:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+30:2371:x1871641503119744:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 342us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936712.492356:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00010000:00010000:3.0:1784936712.492891:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.492903:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.492945:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.492953:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.492960:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.492979:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936712.492984:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.492993:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.493005:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:3.0:1784936712.493009:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784936712.493025:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.493032:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936712.493175:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+29:10497:x1871641503119360:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 19873us (20235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936712.493185:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:0.0:1784936712.503755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936712.506691:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503120000 00000100:00100000:1.0:1784936712.506715:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503120000 00000100:00100000:1.0:1784936712.506865:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:1.0:1784936712.506900:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+29:10497:x1871641503120000:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1784936712.507347:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+30:10497:x1871641503120000:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 452us (3617us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1784936712.507357:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00010000:00010000:2.0:1784936712.520703:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936712.657154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.657274:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503120256 00000100:00100000:3.0:1784936712.657288:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503120256 00000100:00100000:3.0:1784936712.657368:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:3.0:1784936712.657381:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+30:10508:x1871641503120256:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1784936712.657472:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936712.657503:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e21 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.657608:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.657648:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.657677:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.657697:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.657705:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.657712:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658156:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5f81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658168:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658175:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936712.658188:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1784936712.658312:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658321:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658329:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658343:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936712.658348:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658357:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658374:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:3.0:1784936712.658377:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936712.658384:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658391:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658408:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658414:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658420:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658478:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936712.658483:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658490:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658509:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d173a100) 00010000:00010000:3.0:1784936712.658512:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936712.658515:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658521:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658594:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e21 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658610:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e21 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.658618:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:3.0:1784936712.658621:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936712.658624:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4a00, rc 0) 00000100:00100000:3.0:1784936712.658715:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+32:10508:x1871641503120256:12345-192.168.204.1@tcp:101:cat.0 Request processed in 1337us (1576us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1784936712.658735:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:2.0:1784936712.667187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936712.667288:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503120512 00000100:00100000:0.0:1784936712.667302:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503120512 00000100:00100000:0.0:1784936712.667375:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:0.0:1784936712.667396:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+32:10508:x1871641503120512:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:0.0:1784936712.667793:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+33:10508:x1871641503120512:12345-192.168.204.1@tcp:35:cat.0 Request processed in 407us (619us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1784936712.667802:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:1.0:1784936712.711678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936712.711915:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503120768 00000100:00100000:2.0:1784936712.711929:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503120768 00000100:00100000:2.0:1784936712.712008:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:2.0:1784936712.712022:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+33:10509:x1871641503120768:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:2.0:1784936712.712146:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784936712.712184:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f5f81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e21 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712213:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f5f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e1a expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712226:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5f1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e0c expref: 31 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712236:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d173a900) 00010000:00010000:2.0:1784936712.712265:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936712.712294:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712310:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712322:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712337:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712344:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712351:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712853:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712863:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.712871:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936712.714165:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1784936712.714179:0:6621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378465749826ns, next at 379465746298ns, rc = 0 00010000:00010000:2.0:1784936712.714261:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714275:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714288:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714297:0:6621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714305:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714313:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714353:0:6621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784936712.714385:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714400:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714406:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714413:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.714418:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714449:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714465:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d7e59b00) 00010000:00010000:2.0:1784936712.714468:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784936712.714474:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714474:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936712.714480:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f5f9d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714483:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714489:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936712.714493:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714498:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714503:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714507:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9096d7e59b00) 00010000:00010000:2.0:1784936712.714509:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714510:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784936712.714513:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714516:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714520:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f5fa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714522:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936712.714530:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714536:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.714541:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936712.714543:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936712.714544:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936712.714544:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936712.714546:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936712.714548:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936712.714554:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f5f8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936712.714564:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036cebf68 reply state 00000000e1ff4d9c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936712.714575:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936712.715208:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+32:10509:x1871641503120768:12345-192.168.204.1@tcp:36:rm.0 Request processed in 3182us (3561us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1784936712.715218:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 95 00010000:00010000:0.0:1784936712.727245:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.727291:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.727301:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.727309:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936712.727316:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.727326:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.727349:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d7e59500) 00010000:00010000:0.0:1784936712.727353:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936712.727359:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.727367:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f5f96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936712.769424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.769886:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503121024 00000100:00100000:3.0:1784936712.769899:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503121024 00000100:00100000:3.0:1784936712.769983:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:3.0:1784936712.769996:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+31:10515:x1871641503121024:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1784936712.770042:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936712.770075:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5fab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e28 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.770295:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.770316:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.770329:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.770348:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.770355:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.770362:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936712.778928:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1784936712.779705:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.779742:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.779755:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780046:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780073:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780080:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780086:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936712.780090:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780097:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780111:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:3.0:1784936712.780114:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936712.780119:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780124:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f5fb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936712.780142:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000745fcf53 reply state 0000000002933be6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936712.780151:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784936712.780195:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f5fab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780211:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.780231:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:3.0:1784936712.780234:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936712.780237:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5c00, rc 0) 00000100:00100000:3.0:1784936712.780327:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+34:10515:x1871641503121024:12345-192.168.204.1@tcp:101:bash.0 Request processed in 10333us (10920us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1784936712.780337:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00010000:00010000:1.0:1784936712.787566:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.787585:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.787593:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.787599:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936712.787604:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.787612:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.787629:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d173a100) 00010000:00010000:1.0:1784936712.787632:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936712.787637:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936712.787644:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f5fb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936712.788590:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.788889:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503121152 00000100:00100000:3.0:1784936712.788899:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503121152 00000100:00100000:3.0:1784936712.788956:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:3.0:1784936712.788966:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503121152:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1784936712.788985:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936712.789007:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e2f expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936712.789045:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936712.789065:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1784936712.789070:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936712.789080:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.789101:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.789212:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4600, rc 0) 00000100:00100000:2.0:1784936712.789841:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503121152:12345-192.168.204.1@tcp:101:bash.0 Request processed in 862us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936712.789856:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1784936712.803895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.805607:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503121280 00000100:00100000:3.0:1784936712.805644:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503121280 00000100:00100000:3.0:1784936712.805747:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:3.0:1784936712.805758:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:10515:x1871641503121280:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1784936712.805778:0:8072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936712.805800:0:8072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e36 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.805837:0:8072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.805847:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936712.805853:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936712.805858:0:8072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.806508:0:8072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.806528:0:8072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936712.806543:0:8072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ffa64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8072:1871641524110080:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936712.806664:0:8072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936712.813293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936712.813523:0:8072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ffa64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8072:1871641524110080:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936712.813564:0:8072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 7 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936712.813606:0:8072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936712.813680:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:10515:x1871641503121280:12345-192.168.204.1@tcp:101:bash.0 Request processed in 7923us (9805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936712.813689:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:0.0:1784936712.821603:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503121408 00000100:00100000:0.0:1784936712.821619:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503121408 00010000:00010000:0.0:1784936712.821688:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936712.821746:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1784936712.821756:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4648050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503121408:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936712.821770:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936712.821811:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.821830:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.821857:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a46bace9/0x6cf7a864723f5fce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e2f expref: 7 pid: 6598 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.821874:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936712.821878:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936712.821886:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 6 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.821897:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 6 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936712.821942:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 6 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936712.821956:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5782:1871641524110208:192.168.204.1@tcp:105: 00000100:00100000:0.0:1784936712.822041:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb2780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936712.834372:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5782:1871641524110208:192.168.204.1@tcp:105: 00010000:00010000:0.0:1784936712.834403:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936712.834499:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4648050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503121408:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 12743us (21225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936712.834528:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:1.0:1784936712.835743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936712.836331:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503121664 00000100:00100000:0.0:1784936712.836354:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503121664 00000100:00100000:0.0:1784936712.836417:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:0.0:1784936712.836462:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+33:10515:x1871641503121664:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:0.0:1784936712.836845:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+34:10515:x1871641503121664:12345-192.168.204.1@tcp:35:bash.0 Request processed in 417us (1107us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1784936712.836853:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:3.0:1784936713.118941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.119302:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503121792 00000100:00100000:0.0:1784936713.119321:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503121792 00000100:00100000:0.0:1784936713.119415:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:0.0:1784936713.119625:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+34:10531:x1871641503121792:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936713.119664:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.119693:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5fdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e3d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.119777:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.119792:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.119803:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936713.119867:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1784936713.119871:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936713.119917:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.119942:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e3d expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.119961:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e3d expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.119971:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936713.119975:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784936713.119978:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26aa00, rc 0) 00000100:00100000:0.0:1784936713.120236:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+35:10531:x1871641503121792:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 811us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.120245:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:2.0:1784936713.127644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.127925:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503122048 00000100:00100000:0.0:1784936713.127939:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503122048 00000100:00100000:0.0:1784936713.128019:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:0.0:1784936713.128029:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+35:10531:x1871641503122048:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936713.128050:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.128071:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5fea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e44 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.128174:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5ff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.128189:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.128200:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936713.128230:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784936713.128372:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f5fea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e44 expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.128391:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e44 expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.128400:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:0.0:1784936713.128403:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936713.128406:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26bc00, rc 0) 00000100:00100000:0.0:1784936713.128807:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+37:10531:x1871641503122048:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 776us (1176us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1784936713.128815:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:1.0:1784936713.132960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936713.133049:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503122304 00000100:00100000:2.0:1784936713.133061:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503122304 00000100:00100000:2.0:1784936713.133125:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:2.0:1784936713.133135:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+37:10531:x1871641503122304:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936713.133176:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936713.133198:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e4b expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.133318:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.133335:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.133347:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936713.133359:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784936713.133521:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f5fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e4b expref: 40 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.133541:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e4b expref: 39 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.133550:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:2.0:1784936713.133553:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784936713.133557:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18800, rc 0) 00000100:00100000:2.0:1784936713.133627:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+39:10531:x1871641503122304:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 493us (676us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1784936713.133634:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:1.0:1784936713.137752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.137892:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503122432 00000100:00100000:0.0:1784936713.137901:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503122432 00000100:00100000:0.0:1784936713.137961:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:0.0:1784936713.137970:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+39:2371:x1871641503122432:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936713.137985:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936713.138022:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f5ff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e44 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.138040:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:0.0:1784936713.138045:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936713.138104:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+38:2371:x1871641503122432:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.138111:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936713.147756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.148789:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503122560 00000100:00100000:0.0:1784936713.148801:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503122560 00000100:00100000:0.0:1784936713.148926:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1784936713.148936:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503122560:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:0.0:1784936713.148986:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.149216:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 6 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.149226:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936713.149230:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936713.149235:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.149578:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 6 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.149598:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 6 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936713.149615:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6597:1871641524110336:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936713.149732:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784936713.155129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936713.155590:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503122688 00000100:00100000:3.0:1784936713.155600:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503122688 00002000:00100000:3.0:1784936713.155662:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9096fba4b480 x1871641503122688/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:454/0 lens 504/0 e 0 to 0 dl 1784936724 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936713.155674:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fba4b480 with x1871641503122688 ext(0->8) 00010000:00010000:3.0:1784936713.155684:0:6602:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 7 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.155702:0:6602:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 7 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936713.155710:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9096fba4b480 00000100:00100000:3.0:1784936713.155753:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1784936713.155764:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503122688:12345-192.168.204.1@tcp:4:lfs.0 00000100:00100000:3.0:1784936713.156272:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503122688:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 509us (1152us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784936713.156280:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00002000:00100000:3.0:1784936713.156305:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9096fba4b480 x1871641503122688/t4294967302(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:454/0 lens 504/448 e 0 to 0 dl 1784936724 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936713.156326:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fba4b480 with x1871641503122688 ext(0->8) 00010000:00010000:3.0:1784936713.156332:0:6602:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 9 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.156345:0:6602:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 9 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936713.156353:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9096fba4b480 00000100:00100000:0.0:1784936713.157216:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6597:1871641524110336:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936713.157240:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936713.163498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.163677:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503122816 00000100:00100000:0.0:1784936713.163690:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503122816 00010000:00010000:0.0:1784936713.163745:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 9 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936713.163796:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:0.0:1784936713.163806:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+9:2373:x1871641503122816:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936713.163843:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784936713.163864:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784936713.163868:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784936712 00002000:00010000:0.0:1784936713.163870:0:5782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784936713 00002000:00010000:0.0:1784936713.163873:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784936712 00010000:00010000:0.0:1784936713.163879:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 9 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.163904:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 9 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.163928:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a258759/0x6cf7a864723f5fd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e36 expref: 9 pid: 8072 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.163946:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936713.163950:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936713.163955:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.163966:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.164013:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936713.164074:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2373:x1871641503122816:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 269us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.164083:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00010000:00010000:2.0:1784936713.166691:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166741:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166778:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166792:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166800:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166808:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936713.166812:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166819:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166838:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.166845:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa44c717/0x6cf7a864723f6014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936713.166963:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503122560:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 18024us (19212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936713.166972:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:3.0:1784936713.171857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.173228:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503123072 00000100:00100000:0.0:1784936713.173244:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503123072 00000100:00100000:1.0:1784936713.173797:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:1.0:1784936713.173810:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8817450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+38:10531:x1871641503123072:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:1.0:1784936713.173881:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e4b expref: 38 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936713.174509:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1784936713.174557:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1784936713.177280:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1784936713.177374:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.177411:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.177420:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.177489:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.177508:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 42 pid: 5798 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936713.177525:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1871641524110464:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936713.178306:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1784936713.182972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.183043:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503123200 00000100:00100000:0.0:1784936713.183060:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503123200 00010000:00010000:0.0:1784936713.183114:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 43 pid: 5798 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936713.183167:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1784936713.183176:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+43:2372:x1871641503123200:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936713.183193:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936713.183199:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 43 pid: 5798 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.183214:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 43 pid: 5798 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.183235:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:0.0:1784936713.183240:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.183249:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.183256:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.183276:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936713.183354:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+43:2372:x1871641503123200:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 178us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.183361:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00010000:00010000:1.0:1784936713.186233:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f5fc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e28 expref: 42 pid: 5798 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936713.186263:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1871641524110464:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936713.186302:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.186313:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.186320:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936713.186509:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1784936713.186770:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1784936713.186883:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1871641524110592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784936713.186945:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936713.186982:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1784936713.187881:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524110592 00000100:00100000:3.0:1784936713.187899:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524110592 00000100:00100000:3.0:1784936713.188099:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936713.188112:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1871641524110592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784936713.188286:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1871641524110592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 177us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936713.188295:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784936713.188386:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936713.189842:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1871641524110592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784936713.190380:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1784936713.190499:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1871641524110720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784936713.190566:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936713.194606:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1784936713.205477:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524110720 00000100:00100000:2.0:1784936713.205494:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524110720 00000100:00100000:2.0:1784936713.205581:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784936713.205593:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5800:x1871641524110720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784936713.206524:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5800:x1871641524110720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 931us (15953us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784936713.206535:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784936713.206773:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1871641524110720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784936713.206992:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1784936713.207214:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.207226:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.207234:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.207255:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936713.207260:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.207342:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.207359:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:3.0:1784936713.207362:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784936713.207368:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.207375:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f601b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936713.207834:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784936713.208197:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1784936713.208210:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378959781496ns, next at 379959778543ns, rc = 0 00000001:00080000:3.0:1784936713.208218:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1784936713.208260:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096d173af00) 00010000:00010000:3.0:1784936713.208263:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784936713.208345:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e4b expref: 46 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936713.208823:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8817450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+45:10531:x1871641503123072:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 35014us (36974us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1784936713.208834:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000020:00080000:3.0:1784936713.208839:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784936713.214576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.216130:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503123328 00000100:00100000:0.0:1784936713.216153:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503123328 00000100:00100000:0.0:1784936713.216418:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:0.0:1784936713.216472:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+45:10531:x1871641503123328:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936713.216512:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.216545:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e52 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.216625:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e52 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.216644:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e52 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.216666:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.216670:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936713.216674:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ba00, rc 0) 00000100:00100000:0.0:1784936713.219467:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+46:10531:x1871641503123328:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 3021us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.219484:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:1.0:1784936713.227696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.228856:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503123584 00000100:00100000:0.0:1784936713.228876:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503123584 00000100:00100000:0.0:1784936713.228964:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:0.0:1784936713.228976:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+46:10531:x1871641503123584:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936713.230866:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+47:10531:x1871641503123584:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 1875us (3163us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1784936713.230904:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:3.0:1784936713.347996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.348148:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503123712 00000100:00100000:0.0:1784936713.348163:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503123712 00000100:00100000:0.0:1784936713.348253:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:0.0:1784936713.348265:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+47:10541:x1871641503123712:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:0.0:1784936713.348380:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348402:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348419:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348495:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348505:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348513:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348643:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348653:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348660:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936713.348749:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348765:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348772:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348780:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348786:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.348791:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348800:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348814:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936713.348817:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.348823:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348830:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f6029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348845:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348852:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348866:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348872:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.348875:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348882:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348890:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096caf90a00) 00010000:00010000:0.0:1784936713.348892:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.348895:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348901:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348918:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348924:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348931:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348936:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.348939:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348954:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348961:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.348963:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.348966:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.348972:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936713.349060:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+47:10541:x1871641503123712:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 795us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.349069:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:3.0:1784936713.508683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936713.517352:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503123968 00000100:00100000:2.0:1784936713.517374:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503123968 00000100:00100000:0.0:1784936713.517921:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:0.0:1784936713.517940:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+47:10544:x1871641503123968:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936713.517974:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.518004:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f603e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e59 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519061:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519093:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519107:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519148:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519155:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519161:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519349:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f6053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519356:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f6053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519363:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f6053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936713.519376:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784936713.519534:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519542:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519551:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519558:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.519563:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519584:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519601:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936713.519605:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.519610:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519616:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519632:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519639:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519645:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519650:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.519653:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519658:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519664:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096caf90a00) 00010000:00010000:0.0:1784936713.519667:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.519669:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.519966:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f604c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.520037:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f603e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e59 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.520054:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f6053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e59 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.520063:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.520066:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936713.520069:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26bc00, rc 0) 00000100:00100000:0.0:1784936713.520363:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+49:10544:x1871641503123968:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2426us (11692us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1784936713.520373:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:1.0:1784936713.529950:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.530055:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503124096 00000100:00100000:0.0:1784936713.530068:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503124096 00000100:00100000:0.0:1784936713.530146:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:0.0:1784936713.530158:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+49:10544:x1871641503124096:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1784936713.530264:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530286:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530301:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530358:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530365:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530372:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530380:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.530384:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530393:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530408:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.530411:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936713.530417:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.530424:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936713.530549:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+49:10544:x1871641503124096:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 393us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.530558:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 103 00000100:00100000:1.0:1784936713.534300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936713.534472:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503124352 00000100:00100000:3.0:1784936713.534487:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503124352 00000100:00100000:3.0:1784936713.534561:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:3.0:1784936713.534573:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+49:10544:x1871641503124352:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936713.534920:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+50:10544:x1871641503124352:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 348us (635us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1784936713.534933:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00010000:00010000:2.0:1784936713.545026:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936713.661831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.662759:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503124608 00000100:00100000:0.0:1784936713.662774:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503124608 00000100:00100000:0.0:1784936713.662857:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:0.0:1784936713.662887:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+50:10554:x1871641503124608:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936713.662923:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.662927:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784936713.662962:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f5fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e3d expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.662987:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936713.662993:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936713.663030:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6068 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e60 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.663528:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f606f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.663547:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f606f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.663560:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f606f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936713.663573:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784936713.663898:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6068 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e60 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.663919:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f606f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e60 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.663928:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.663931:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936713.663946:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a600, rc 0) 00000100:00100000:0.0:1784936713.664478:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+51:10554:x1871641503124608:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1589us (2658us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1784936713.664490:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:1.0:1784936713.671612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.671837:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503124864 00000100:00100000:0.0:1784936713.671853:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503124864 00000100:00100000:0.0:1784936713.671974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 105 00000100:00100000:0.0:1784936713.671986:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+51:10554:x1871641503124864:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:0.0:1784936713.672397:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784936713.672480:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f606f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e60 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.672511:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f6053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e59 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.672523:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.672529:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936713.672946:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.672966:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.672978:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936713.673336:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1784936713.673365:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012ee2ccc reply state 00000000592c652e transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936713.673401:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936713.673653:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10554:x1871641503124864:12345-192.168.204.1@tcp:36:bash.0 Request processed in 1666us (2056us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1784936713.673678:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 105 00000020:00080000:0.0:1784936713.673685:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784936713.679620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:0.0:1784936713.680119:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.680137:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.680147:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.680156:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.680162:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.680172:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.680198:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.680201:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.680208:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.680215:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f607d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936713.680868:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503124992 00000100:00100000:2.0:1784936713.680884:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503124992 00000100:00100000:2.0:1784936713.681005:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00100000:2.0:1784936713.681024:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+51:10554:x1871641503124992:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936713.681244:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936713.681270:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e67 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.681387:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.681404:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.681465:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936713.681502:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784936713.681507:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936713.681533:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.681561:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.681579:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.681589:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:2.0:1784936713.681592:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936713.681595:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18400, rc 0) 00000100:00100000:2.0:1784936713.681754:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+52:10554:x1871641503124992:12345-192.168.204.1@tcp:101:bash.0 Request processed in 731us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936713.681761:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 106 00000100:00100000:3.0:1784936713.686007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.686487:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503125248 00000100:00100000:0.0:1784936713.686530:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503125248 00000100:00100000:0.0:1784936713.686606:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:0.0:1784936713.686618:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+52:10554:x1871641503125248:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:0.0:1784936713.686936:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+53:10554:x1871641503125248:12345-192.168.204.1@tcp:35:bash.0 Request processed in 319us (958us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1784936713.686945:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:3.0:1784936713.769017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936713.769262:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503125376 00000100:00100000:2.0:1784936713.769275:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503125376 00000100:00100000:2.0:1784936713.769362:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:2.0:1784936713.769374:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+53:10560:x1871641503125376:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936713.769409:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936713.769486:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e6e expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.769603:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.769621:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.769636:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936713.769744:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1784936713.769749:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936713.769775:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.769804:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e6e expref: 55 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.769826:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e6e expref: 54 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.769837:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936713.769840:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784936713.769844:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18800, rc 0) 00000100:00100000:2.0:1784936713.769921:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+54:10560:x1871641503125376:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 549us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936713.769928:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 107 00000100:00100000:1.0:1784936713.775383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.775528:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503125504 00000100:00100000:0.0:1784936713.775542:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503125504 00000100:00100000:0.0:1784936713.775616:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 108 00000100:00100000:0.0:1784936713.775628:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+54:10560:x1871641503125504:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936713.775674:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.775710:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.775798:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.775815:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.775828:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.775844:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.775851:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.775858:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776026:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776036:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776043:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936713.776405:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784936713.776412:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936713.776467:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776482:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776492:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776499:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776506:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776514:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.776519:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776528:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776555:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936713.776559:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.776565:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776573:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776589:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776596:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776601:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776607:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936713.776610:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776616:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776623:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096caf90a00) 00010000:00010000:0.0:1784936713.776625:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936713.776628:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776634:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776785:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776803:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.776811:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.776813:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936713.776816:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a000, rc 0) 00000100:00100000:0.0:1784936713.777022:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+55:10560:x1871641503125504:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1393us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.777032:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 108 00000100:00100000:1.0:1784936713.782525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936713.782696:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503125760 00000100:00100000:2.0:1784936713.782721:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503125760 00000100:00100000:2.0:1784936713.782817:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:2.0:1784936713.782828:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+55:10560:x1871641503125760:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936713.782856:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936713.782886:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f60bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e7c expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783042:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783060:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783070:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783088:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783135:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783155:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 56 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936713.783171:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524110848:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936713.783303:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.783327:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936713.783337:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524110976:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936713.783366:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7ec9480 going to sleep for 11 seconds 00000100:00100000:3.0:1784936713.787518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.787647:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503125888 00000100:00100000:0.0:1784936713.787661:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503125888 00010000:00010000:0.0:1784936713.787728:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 57 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936713.787780:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:0.0:1784936713.787791:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+57:2371:x1871641503125888:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936713.787810:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936713.787819:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 57 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.787838:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 57 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.787890:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.787896:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.787906:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.787914:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936713.787989:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+57:2371:x1871641503125888:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 199us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.787998:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00010000:00010000:2.0:1784936713.789223:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f60b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e75 expref: 56 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936713.789253:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524110848:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936713.789270:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524110976:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936713.789308:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936713.792315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936713.792533:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503126016 00000100:00100000:2.0:1784936713.792545:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503126016 00010000:00010000:2.0:1784936713.792599:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936713.792651:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1784936713.792814:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+56:2372:x1871641503126016:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936713.792839:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936713.792847:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.792866:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.792912:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f608b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e67 expref: 56 pid: 5798 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.792932:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:2.0:1784936713.792938:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.792950:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.792960:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.793012:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936713.793139:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+55:2372:x1871641503126016:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 478us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936713.793149:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00010000:00010000:1.0:1784936713.793323:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.793334:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936713.793360:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784936713.793602:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f60bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 56 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.793623:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 55 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936713.793646:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:1.0:1784936713.793649:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784936713.793653:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19a00, rc 0) 00000100:00100000:1.0:1784936713.793712:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+55:10560:x1871641503125760:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 10876us (11193us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1784936713.793721:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 109 00000100:00100000:1.0:1784936713.798093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936713.798340:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503126272 00000100:00100000:3.0:1784936713.798355:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503126272 00000100:00100000:3.0:1784936713.798492:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1784936713.798507:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+55:10560:x1871641503126272:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:3.0:1784936713.798530:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936713.798564:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e52 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936713.798590:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:3.0:1784936713.798597:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936713.798962:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+54:10560:x1871641503126272:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 457us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936713.798996:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:3.0:1784936713.804776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936713.804985:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503126400 00000100:00100000:2.0:1784936713.805009:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503126400 00000100:00100000:2.0:1784936713.805093:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:2.0:1784936713.805106:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+54:10560:x1871641503126400:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:2.0:1784936713.805242:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.805264:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936713.805278:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936713.805965:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784936713.806222:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+54:10560:x1871641503126400:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 1116us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936713.806233:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 110 00000100:00100000:2.0:1784936713.809404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936713.809608:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503126528 00000100:00100000:0.0:1784936713.809622:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503126528 00000100:00100000:0.0:1784936713.809715:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 111 00000100:00100000:0.0:1784936713.809726:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+54:10560:x1871641503126528:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936713.809755:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936713.809782:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e83 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.809863:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.809876:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.809899:0:5797:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.809937:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.809954:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936713.809958:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936713.809962:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936713.809971:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b600, rc 0) 00000100:00100000:0.0:1784936713.810062:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+55:10560:x1871641503126528:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 338us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936713.810071:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 111 00000040:00080000:1.0:1784936714.186581:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936714.186595:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936714.186665:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1784936714.186673:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784936714.186856:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524111104:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784936714.186996:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936714.192958:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524111104:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784936714.194025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.197359:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503126656 00000100:00100000:0.0:1784936714.197380:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503126656 00000100:00100000:0.0:1784936714.197511:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00100000:0.0:1784936714.197528:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+55:10561:x1871641503126656:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784936714.197573:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784936714.197779:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+55:10561:x1871641503126656:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 256us (3759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.197789:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 112 00000100:00080000:3.0:1784936714.197902:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936714.202030:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.202521:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503126784 00000100:00100000:0.0:1784936714.202535:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503126784 00000100:00100000:0.0:1784936714.202617:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:0.0:1784936714.202628:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+55:10561:x1871641503126784:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.202741:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202781:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202796:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202814:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202821:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202828:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202854:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202862:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202868:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936714.202916:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784936714.202921:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936714.202939:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202951:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202966:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202973:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.202980:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.202995:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203004:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203137:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:0.0:1784936714.203141:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936714.203147:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203154:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f60df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203172:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203178:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203184:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203190:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.203200:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203206:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203214:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9096caf90a00) 00010000:00010000:0.0:1784936714.203217:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936714.203220:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203226:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f60e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203243:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203250:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203256:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203262:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.203264:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203270:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203277:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936714.203279:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936714.203288:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.203648:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f60ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.203957:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+55:10561:x1871641503126784:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 1326us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.203968:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 113 00000100:00100000:1.0:1784936714.211520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.211614:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503127040 00000100:00100000:0.0:1784936714.211627:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503127040 00000100:00100000:0.0:1784936714.211708:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:0.0:1784936714.211721:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+55:10561:x1871641503127040:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.211757:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936714.211796:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f60f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e8a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.211942:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.211962:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.211977:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936714.212004:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784936714.212336:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212345:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212373:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212380:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.212385:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212393:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212408:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936714.212411:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784936714.212417:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212423:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f60fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212532:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f60f4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e8a expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212544:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:0.0:1784936714.212546:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936714.212550:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f60f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e8a expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.212562:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ae00, rc 0) 00000100:00100000:0.0:1784936714.212638:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+56:10561:x1871641503127040:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 919us (1133us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1784936714.212655:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:3.0:1784936714.216372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.217281:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503127168 00000100:00100000:0.0:1784936714.217632:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503127168 00000100:00100000:0.0:1784936714.217746:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:0.0:1784936714.217759:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+56:10561:x1871641503127168:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784936714.217818:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784936714.217972:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+56:10561:x1871641503127168:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 215us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.217990:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:2.0:1784936714.234301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.234495:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503127424 00000100:00100000:3.0:1784936714.234508:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503127424 00000100:00100000:3.0:1784936714.234578:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:3.0:1784936714.234590:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+56:10561:x1871641503127424:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784936714.234619:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936714.234623:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784936714.234658:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e6e expref: 56 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.234684:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:3.0:1784936714.234690:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936714.234720:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6109 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e91 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936714.235279:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1784936714.241164:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.241195:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.241210:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.241332:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6109 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e91 expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.241359:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e91 expref: 57 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.241368:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096d173af00) 00010000:00010000:3.0:1784936714.241372:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936714.241375:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5600, rc 0) 00000100:00100000:3.0:1784936714.241501:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+57:10561:x1871641503127424:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 6912us (7213us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1784936714.241512:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:3.0:1784936714.246547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.246652:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503127680 00000100:00100000:0.0:1784936714.246677:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503127680 00000100:00100000:0.0:1784936714.246767:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:0.0:1784936714.246779:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+57:10561:x1871641503127680:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.246863:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936714.246902:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e91 expref: 57 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.246927:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096d173af00) 00010000:00010000:0.0:1784936714.246955:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936714.246982:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247010:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247022:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247075:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247083:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247091:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247192:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247201:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247210:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247217:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.247222:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247231:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247241:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:0.0:1784936714.247245:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936714.247249:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247256:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f611e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247274:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247280:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247287:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247293:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.247297:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247304:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247311:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x89af951b (ffff9096caf90a00) 00010000:00010000:0.0:1784936714.247314:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936714.247317:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.247323:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6125 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x89af951b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.247843:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+56:10561:x1871641503127680:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1060us (1304us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784936714.247853:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:1.0:1784936714.257824:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.257934:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503127808 00000100:00100000:0.0:1784936714.257949:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503127808 00000100:00100000:0.0:1784936714.258039:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:0.0:1784936714.258079:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+56:10561:x1871641503127808:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.258112:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936714.258144:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f612c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e98 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.258201:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.258217:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.258234:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.258370:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f612c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.258393:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.258402:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:0.0:1784936714.258405:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784936714.258410:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ae00, rc 0) 00000100:00100000:0.0:1784936714.258545:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+57:10561:x1871641503127808:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 478us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.258553:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:2.0:1784936714.263892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936714.264020:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503128064 00000100:00100000:1.0:1784936714.264035:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503128064 00000100:00100000:1.0:1784936714.264131:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:1.0:1784936714.264144:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+57:10561:x1871641503128064:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784936714.264268:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.264557:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.264597:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784936714.264956:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1784936714.264967:0:6621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380016538366ns, next at 381016535572ns, rc = 0 00000004:00010000:1.0:1784936714.265525:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6cc9c3a reply state 00000000e655989e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.265540:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784936714.265713:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+59:10561:x1871641503128064:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1567us (1834us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1784936714.265722:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 119 00010000:00010000:1.0:1784936714.280055:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.280089:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.280098:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.280106:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936714.280112:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.280122:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.280144:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:1.0:1784936714.280147:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784936714.280173:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.280181:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f613a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.286647:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.286982:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503128192 00000100:00100000:0.0:1784936714.286996:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503128192 00000100:00100000:0.0:1784936714.287100:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:0.0:1784936714.287136:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+58:10561:x1871641503128192:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.287173:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936714.287203:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94e9f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.287313:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.287334:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.287363:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:0.0:1784936714.287367:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936714.287373:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b000, rc 0) 00000100:00100000:0.0:1784936714.287527:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+59:10561:x1871641503128192:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 393us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.287536:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 120 00000100:00100000:2.0:1784936714.294591:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.295051:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503128320 00000100:00100000:0.0:1784936714.295064:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503128320 00000100:00100000:0.0:1784936714.295174:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:0.0:1784936714.295187:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503128320:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784936714.295930:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936714.295971:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503128320:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 785us (1396us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784936714.295982:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:1.0:1784936714.312577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.313173:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503128576 00000100:00100000:0.0:1784936714.313188:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503128576 00000100:00100000:0.0:1784936714.313529:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1784936714.313543:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+59:10561:x1871641503128576:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784936714.315405:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+60:10561:x1871641503128576:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1850us (2828us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1784936714.315421:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:1.0:1784936714.337764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.337874:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503128832 00000100:00100000:0.0:1784936714.337887:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503128832 00000100:00100000:0.0:1784936714.337963:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:0.0:1784936714.337975:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+60:10561:x1871641503128832:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784936714.338151:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+60:10561:x1871641503128832:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 177us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.338161:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:2.0:1784936714.341304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.341892:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503128960 00000100:00100000:0.0:1784936714.341907:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503128960 00000100:00100000:0.0:1784936714.341993:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:0.0:1784936714.342006:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+60:10561:x1871641503128960:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.342037:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936714.342078:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ea6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.342178:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f614f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.342196:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f614f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.342210:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f614f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936714.342263:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936714.342287:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f614f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.342331:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ea6 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.342352:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f614f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ea6 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.342362:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:0.0:1784936714.342367:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784936714.342370:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26bc00, rc 0) 00000100:00100000:0.0:1784936714.342478:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+61:10561:x1871641503128960:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 474us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.342485:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 122 00000100:00100000:3.0:1784936714.363266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.363475:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129088 00000100:00100000:2.0:1784936714.363489:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129088 00000100:00100000:2.0:1784936714.363559:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1784936714.363570:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503129088:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936714.363597:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936714.363627:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ead expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784936714.363664:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f90a, blocks: 0x1 00010000:00010000:2.0:1784936714.363705:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1784936714.363711:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936714.363722:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 10 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.363747:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 10 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.363786:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18000, rc 0) 00000100:00100000:2.0:1784936714.363878:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+10:2372:x1871641503129088:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 310us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936714.363887:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:1.0:1784936714.369546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.369708:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129344 00000100:00100000:0.0:1784936714.369721:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129344 00000100:00100000:0.0:1784936714.369811:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:0.0:1784936714.369824:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+61:10561:x1871641503129344:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784936714.370018:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+61:10561:x1871641503129344:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 196us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.370026:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 123 00000100:00100000:3.0:1784936714.377570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.378214:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129472 00000100:00100000:0.0:1784936714.378228:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129472 00000100:00100000:0.0:1784936714.378321:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:0.0:1784936714.378353:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+10:10561:x1871641503129472:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.378381:0:6595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936714.378407:0:6595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94eb4 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.378772:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 11 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.378785:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936714.378791:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936714.378798:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.378877:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 11 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.378899:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 11 pid: 6598 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.378918:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6595:1871641524111232:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936714.379099:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936714.384554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.384631:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129600 00000100:00100000:2.0:1784936714.384643:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129600 00010000:00010000:2.0:1784936714.384715:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 12 pid: 6598 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.384810:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:2.0:1784936714.384822:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d464b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+12:2371:x1871641503129600:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936714.384842:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936714.384874:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 12 pid: 6598 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.384894:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 12 pid: 6598 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.384927:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936714.384932:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936714.384944:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.384955:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.385042:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.385060:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5781:1871641524111360:192.168.204.1@tcp:105: 00000100:00100000:2.0:1784936714.385179:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7ec9480 going to sleep for 11 seconds 00010000:00010000:1.0:1784936714.390320:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6156 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ead expref: 12 pid: 6598 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.390388:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6595:1871641524111232:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936714.390476:0:6595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.390497:0:6595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26aa00, rc 0) 00000100:00100000:1.0:1784936714.390673:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+11:10561:x1871641503129472:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 12308us (13103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936714.390683:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:2.0:1784936714.403733:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5781:1871641524111360:192.168.204.1@tcp:105: 00010000:00010000:2.0:1784936714.403780:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936714.404034:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d464b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+10:2371:x1871641503129600:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 19212us (19492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936714.404047:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:1.0:1784936714.409685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.409842:0:6601:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129728 00000100:00100000:2.0:1784936714.409861:0:6601:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129728 00002000:00100000:2.0:1784936714.409943:0:6601:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9096d4665880 x1871641503129728/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:455/0 lens 504/0 e 0 to 0 dl 1784936725 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784936714.409958:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096d4665880 with x1871641503129728 ext(0->12) 00002000:00010000:2.0:1784936714.409966:0:6601:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096d4665880 00000100:00100000:2.0:1784936714.410021:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1784936714.410033:0:6601:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+10:2371:x1871641503129728:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784936714.410824:0:6601:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+12:2371:x1871641503129728:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 788us (1149us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784936714.410835:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00002000:00100000:2.0:1784936714.410845:0:6601:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9096d4665880 x1871641503129728/t4294967308(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:455/0 lens 504/448 e 0 to 0 dl 1784936725 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784936714.410867:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096d4665880 with x1871641503129728 ext(0->12) 00002000:00010000:2.0:1784936714.410872:0:6601:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096d4665880 00000100:00100000:0.0:1784936714.416574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.416781:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129856 00000100:00100000:2.0:1784936714.416795:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129856 00000100:00100000:2.0:1784936714.416874:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 124 00000100:00100000:2.0:1784936714.416886:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+61:10561:x1871641503129856:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1784936714.525754:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+61:10561:x1871641503129856:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 108852us (109179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936714.525773:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 124 00000001:00080000:2.0:1784936714.525847:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1784936714.525903:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1784936714.525927:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096ef0ed600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1784936714.525932:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096ee373700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096ef0edf00 00000020:00080000:2.0:1784936714.525936:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096ee373400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096ed9f6c00 00000004:00080000:2.0:1784936714.525978:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1784936714.525992:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096ff49a000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1784936714.525995:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096c2cd9500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096ff49a900 00000020:00080000:2.0:1784936714.525998:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096c2cd9600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096ef135000 00000020:00080000:2.0:1784936714.526015:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1784936714.526030:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1784936714.526476:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1784936714.526529:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524111616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784936714.526609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784936714.526757:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784936714.526841:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524111488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784936714.526875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936714.526932:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524111744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784936714.526959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936714.526959:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524111616 00000100:00100000:0.0:1784936714.526969:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524111616 00000100:00100000:2.0:1784936714.527002:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524111488 00000100:00100000:2.0:1784936714.527006:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524111488 00000100:00100000:2.0:1784936714.527030:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524111744 00000100:00100000:2.0:1784936714.527033:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524111744 00000100:00100000:0.0:1784936714.527179:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784936714.527190:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524111488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784936714.527230:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1784936714.527267:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.527293:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.527303:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784936714.527309:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936714.527314:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.527346:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.527363:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 11 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.527394:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524111872:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936714.527479:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb23c0 going to sleep for 11 seconds 00000100:00080000:0.0:1784936714.527494:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936714.528296:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784936714.528315:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524111616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784936714.528579:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784936714.528583:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784936714 00002000:00010000:2.0:1784936714.528586:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784936714.528588:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784936714 -> 1784936714 00002000:00010000:2.0:1784936714.528590:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784936714.528666:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1871641524111616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 359us (2057us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784936714.528675:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784936714.528709:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784936714.528718:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524111744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784936714.528740:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1784936714.528772:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a63f908, atime: 0x6a63f909, ctime: 0x6a63f908, blocks: 0x1 00010000:00010000:2.0:1784936714.528780:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.528795:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1784936714.528811:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936714.528819:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.528858:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.528872:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.528881:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.528912:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936714.528984:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936714.528993:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.529002:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936714.529007:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.529018:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.529041:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.529062:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f616b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.529086:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936714.529088:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936714.529090:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936714.532138:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1871641524111744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3407us (5163us total) trans 4294967304 rc 0/0 00000004:00080000:1.0:1784936714.532270:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096c593df80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1784936714.532280:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524111744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784936714.532665:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1784936714.533567:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096c593fb80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1784936714.533579:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524111616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784936714.535055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.535092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.535279:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524111872:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936714.535323:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936714.535632:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503130112 00000100:00100000:3.0:1784936714.535641:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503130112 00010000:00010000:3.0:1784936714.535713:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 12 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.535997:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503129984 00000100:00100000:1.0:1784936714.536003:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503129984 00000100:00100000:1.0:1784936714.536176:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:1.0:1784936714.536189:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+13:2371:x1871641503129984:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784936714.536232:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1784936714.536242:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+13:2371:x1871641503130112:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936714.536257:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936714.536264:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 13 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536288:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 13 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536472:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f5f26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e13 expref: 13 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536497:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936714.536503:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936714.536510:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536521:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536562:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936714.536618:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.536631:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936714.536638:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+12:2371:x1871641503130112:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 395us (1592us total) trans 0 rc 0/0 00010000:00010000:2.0:1784936714.536649:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936714.536651:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00010000:00010000:2.0:1784936714.536675:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.536706:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936714.536719:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936714.536728:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536739:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936714.536744:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536756:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.536771:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.537956:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603eaa5b/0x6cf7a864723f6164 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.538254:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936714.538258:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936714.538260:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936714.538892:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1871641524111488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11697us (12010us total) trans 4294967310 rc 0/0 00000004:00080000:3.0:1784936714.539422:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096c593e300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1784936714.539455:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524111488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784936714.540721:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1784936714.568955:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784936714.617519:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1784936714.617548:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1784936714.617558:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1784936714.617732:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503129984:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 81535us (82627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936714.617749:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:0.0:1784936714.624359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.626338:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503130368 00000100:00100000:3.0:1784936714.626361:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503130368 00000100:00100000:3.0:1784936714.626522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:3.0:1784936714.626537:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:10561:x1871641503130368:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784936714.626653:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936714.626706:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f614f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ea6 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.626734:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:3.0:1784936714.626739:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936714.626783:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.626801:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.626816:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936714.627726:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9b88dc7 reply state 00000000c4b417e0 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.627745:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936714.627910:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+16:10561:x1871641503130368:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1373us (3564us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1784936714.627919:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 125 00000100:00100000:1.0:1784936714.638759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:3.0:1784936714.638840:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.638902:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.638912:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.638919:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936714.638925:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.638934:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.638983:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:3.0:1784936714.638986:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936714.638992:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.639010:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6172 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.639185:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503130496 00000100:00100000:2.0:1784936714.639200:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503130496 00000100:00100000:2.0:1784936714.639273:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:2.0:1784936714.639285:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503130496:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784936714.639699:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784936714.639705:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1784936714 -> 1784936713 00002000:00010000:2.0:1784936714.639720:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784936713 00002000:00010000:2.0:1784936714.639722:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784936714 -> 1784936713 00002000:00010000:2.0:1784936714.639725:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784936714.639806:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503130496:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 522us (1060us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784936714.639815:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:0.0:1784936714.645344:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.647198:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503130752 00000100:00100000:3.0:1784936714.647222:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503130752 00000100:00100000:3.0:1784936714.647333:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:3.0:1784936714.647347:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+15:10561:x1871641503130752:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784936714.647469:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.647491:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.647501:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.647550:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.647570:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 15 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936714.647588:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ffa66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524112000:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936714.647753:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936714.652865:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ffa66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524112000:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936714.652908:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.653104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936714.653256:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503130880 00000100:00100000:1.0:1784936714.653267:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503130880 00010000:00010000:1.0:1784936714.653319:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.653361:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:1.0:1784936714.653371:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+16:2371:x1871641503130880:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936714.653416:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936714.653453:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.653472:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.653502:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e98 expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.653520:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:1.0:1784936714.653525:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.653535:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.653543:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.653580:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936714.654108:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654121:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654163:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654171:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654179:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654186:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936714.654191:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654200:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654210:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:2.0:1784936714.654213:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784936714.654228:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.654235:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6179 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.656701:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+15:2371:x1871641503130880:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 3298us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936714.656724:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:2.0:1784936714.656885:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+14:10561:x1871641503130752:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 9539us (11556us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784936714.656898:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 126 00000100:00100000:2.0:1784936714.670869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.670991:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503131008 00000100:00100000:0.0:1784936714.671066:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503131008 00000100:00100000:0.0:1784936714.671154:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:0.0:1784936714.671168:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503131008:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784936714.671239:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.671267:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 7 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.671278:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936714.671284:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936714.671289:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.671339:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 7 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.671360:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 7 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.671380:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524112128:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936714.674228:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936714.686933:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524112128:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936714.686990:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.688240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.688586:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503131136 00000100:00100000:0.0:1784936714.688601:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503131136 00010000:00010000:0.0:1784936714.688656:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 8 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.688914:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:0.0:1784936714.688926:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503131136:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936714.688945:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936714.688979:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 8 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.688997:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 8 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.689026:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f615d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eb4 expref: 8 pid: 6595 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.689048:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936714.689053:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936714.689072:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.689085:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.689123:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936714.689194:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503131136:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 269us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.689203:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00010000:00010000:1.0:1784936714.689486:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689497:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689528:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689537:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689546:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689554:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936714.689559:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689569:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689584:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.689604:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc030d2a/0x6cf7a864723f6180 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.689699:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503131008:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 18533us (18844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936714.689709:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:2.0:1784936714.694012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936714.694165:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503131392 00000100:00100000:1.0:1784936714.694179:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503131392 00000100:00100000:1.0:1784936714.694259:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 127 00000100:00100000:1.0:1784936714.694273:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+14:10561:x1871641503131392:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784936714.694398:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694424:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694481:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694774:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694789:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694798:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694865:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.694886:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 15 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.694907:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524112256:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936714.695022:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936714.699768:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524112256:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936714.699812:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.701219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936714.701309:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503131520 00000100:00100000:1.0:1784936714.701321:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503131520 00010000:00010000:1.0:1784936714.701375:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936714.701425:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:1.0:1784936714.701479:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+16:2372:x1871641503131520:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936714.701500:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936714.701509:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.701527:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.701555:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e9f expref: 16 pid: 5796 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.701575:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:1.0:1784936714.701604:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.701619:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.701628:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936714.701673:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936714.701760:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+15:2372:x1871641503131520:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 281us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936714.701769:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00010000:00010000:2.0:1784936714.702829:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.702845:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936714.703150:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1784936714.703333:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1784936714.703386:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1784936714.703560:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524112384:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784936714.703640:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936714.703700:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096cac1e240 going to sleep for 11 seconds 00000100:00100000:0.0:1784936714.704411:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524112384 00000100:00100000:0.0:1784936714.704422:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524112384 00000100:00100000:0.0:1784936714.704509:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936714.704520:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524112384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784936714.704628:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524112384:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.704636:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784936714.705004:0:6621:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1784936714.705013:0:6621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1784936714.705040:0:6621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096c593fb80, transno 4294967309 00000100:00100000:3.0:1784936714.705077:0:6621:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9096c593e300 x1871641524111488/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784936730 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936714.705092:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524112384:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1784936714.706345:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1784936714.706573:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ffa66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524112512:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784936714.706657:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936714.706810:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784936714.707244:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524112512 00000100:00100000:2.0:1784936714.707256:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524112512 00000100:00100000:2.0:1784936714.707309:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936714.707318:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524112512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784936714.707876:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6621:x1871641524112512:12345-0@lo:1000:mdt00_003.0 Request processed in 556us (1217us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784936714.707902:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784936714.708317:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ffa66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524112512:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784936714.708371:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708383:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708390:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708408:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936714.708413:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708422:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708681:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:3.0:1784936714.708693:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784936714.708700:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708708:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f618e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708747:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708754:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708760:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708765:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936714.708767:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708773:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708793:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:3.0:1784936714.708795:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784936714.708805:0:6621:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708819:0:6621:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.708828:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.709196:0:6621:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.709216:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524112640:192.168.204.1@tcp:105: 00000100:00100000:2.0:1784936714.709372:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372900 going to sleep for 11 seconds 00000100:00100000:2.0:1784936714.713026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.713231:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503131648 00000100:00100000:3.0:1784936714.713243:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503131648 00000100:00100000:3.0:1784936714.713313:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1784936714.713324:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+19:10560:x1871641503131648:12345-192.168.204.1@tcp:49:lfs.0 00000100:00100000:3.0:1784936714.713525:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+19:10560:x1871641503131648:12345-192.168.204.1@tcp:49:lfs.0 Request processed in 202us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936714.713532:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:2.0:1784936714.716087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.716177:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503131904 00000100:00100000:3.0:1784936714.716190:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503131904 00000100:00100000:3.0:1784936714.716257:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 128 00000100:00100000:3.0:1784936714.716268:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+19:10560:x1871641503131904:12345-192.168.204.1@tcp:58:lfs.0 00000040:00080000:3.0:1784936714.716787:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1784936714.716896:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+19:10560:x1871641503131904:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 629us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936714.716905:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 128 00000100:00100000:0.0:1784936714.718029:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524112640:192.168.204.1@tcp:105: 00010000:00010000:0.0:1784936714.718082:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718095:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f60d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718141:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718158:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718173:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718184:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718192:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718200:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718227:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.718232:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718239:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718253:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936714.718256:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936714.718261:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718267:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6195 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718278:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718283:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718289:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718293:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936714.718296:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718300:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718318:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936714.718321:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784936714.718324:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.718330:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6187 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.718590:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+18:10561:x1871641503131392:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 24318us (24591us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1784936714.718600:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 127 00000020:00080000:0.0:1784936714.718607:0:6621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784936714.718890:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936714.718896:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936714.718933:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784936714.718941:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784936714.719105:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524112768:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784936714.719171:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936714.725839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936714.726040:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524112768:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784936714.726794:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503132160 00000100:00100000:3.0:1784936714.726808:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503132160 00000100:00100000:3.0:1784936714.726888:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:3.0:1784936714.726901:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+18:10561:x1871641503132160:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784936714.731810:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784936714.731939:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1784936714.732048:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.732073:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.732089:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.732099:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.732105:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.732112:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.732140:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784936714.732312:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+20:10561:x1871641503132160:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 5406us (6483us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1784936714.732323:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000020:00080000:2.0:1784936714.732332:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784936714.733042:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936714.733066:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.733079:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936714.733084:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.733093:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.733114:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9096d7e59400) 00010000:00010000:3.0:1784936714.733117:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784936714.733123:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.733130:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f619c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.733165:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936714.733167:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936714.733169:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936714.737900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.740651:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503132288 00000100:00100000:0.0:1784936714.740680:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503132288 00000100:00100000:0.0:1784936714.740838:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00100000:0.0:1784936714.740852:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+20:10562:x1871641503132288:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784936714.740901:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784936714.741060:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+20:10562:x1871641503132288:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 211us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.741067:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 129 00000100:00100000:0.0:1784936714.755260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.755550:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503132544 00000100:00100000:2.0:1784936714.755565:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503132544 00000100:00100000:2.0:1784936714.755638:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 130 00000100:00100000:2.0:1784936714.755650:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+20:10562:x1871641503132544:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936714.755707:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936714.755740:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f61a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ebb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.755881:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f61aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.755900:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f61aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.755914:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f61aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936714.755928:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1784936714.756245:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f61a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ebb expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.756270:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f61aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ebb expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.756304:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:2.0:1784936714.756308:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784936714.756313:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18400, rc 0) 00000100:00100000:2.0:1784936714.756402:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+22:10562:x1871641503132544:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 753us (1159us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784936714.756410:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 130 00000100:00100000:2.0:1784936714.771923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.772187:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503132800 00000100:00100000:3.0:1784936714.772203:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503132800 00000100:00100000:3.0:1784936714.772331:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 131 00000100:00100000:3.0:1784936714.772345:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+22:10562:x1871641503132800:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784936714.772532:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772560:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772576:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772859:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772868:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772876:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772884:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936714.772889:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772898:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772914:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:3.0:1784936714.772918:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784936714.772926:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.772933:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936714.773182:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+23:10562:x1871641503132800:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 839us (1275us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1784936714.773192:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 131 00000040:00080000:1.0:1784936714.773393:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936714.773399:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936714.773908:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784936714.773919:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784936714.781337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936714.781509:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503133056 00000100:00100000:2.0:1784936714.781525:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503133056 00000100:00100000:2.0:1784936714.781607:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:2.0:1784936714.781619:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+23:10562:x1871641503133056:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784936714.781990:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+24:10562:x1871641503133056:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 371us (674us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1784936714.781999:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:2.0:1784936714.791597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.791966:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503133184 00000100:00100000:3.0:1784936714.791989:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503133184 00000100:00100000:3.0:1784936714.792348:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 132 00000100:00100000:3.0:1784936714.792362:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+24:10564:x1871641503133184:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936714.792398:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936714.792451:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ec2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.792542:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.792562:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.792576:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.792592:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.792599:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.792605:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.793043:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.793131:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 25 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.793142:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.793195:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 25 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.793217:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 25 pid: 6621 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936714.793235:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ffa65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524112896:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936714.793363:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936714.799373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936714.799951:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ffa65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524112896:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936714.800002:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936714.800614:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503133440 00000100:00100000:2.0:1784936714.800625:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503133440 00000100:00100000:2.0:1784936714.800813:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1784936714.801313:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+26:5588:x1871641503133440:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784936714.802355:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+27:5588:x1871641503133440:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 1047us (2990us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1784936714.802367:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:2.0:1784936714.807133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936714.807531:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503133568 00000100:00100000:0.0:1784936714.807545:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503133568 00010000:00010000:0.0:1784936714.807614:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 27 pid: 6621 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936714.807689:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1784936714.807721:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+27:2371:x1871641503133568:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936714.807743:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936714.807752:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 27 pid: 6621 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.807776:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 27 pid: 6621 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.807805:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f60c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e7c expref: 27 pid: 6621 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.807999:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:0.0:1784936714.808007:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.808019:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.808027:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936714.808173:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936714.808266:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+26:2371:x1871641503133568:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 546us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936714.808274:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00010000:00010000:3.0:1784936714.810375:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936714.810398:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936714.810934:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784936714.810967:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936714.811142:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811170:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811183:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811191:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811201:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811209:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936714.811216:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811227:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811249:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:2.0:1784936714.811253:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936714.811260:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811267:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f61c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811290:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811308:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811315:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811321:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936714.811324:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811331:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811340:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9096d173a700) 00010000:00010000:2.0:1784936714.811343:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936714.811345:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811351:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f61cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811422:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f61bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ec2 expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811642:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ec2 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936714.811651:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:2.0:1784936714.811654:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936714.811755:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5c00, rc 0) 00000100:00100000:2.0:1784936714.812007:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+25:10564:x1871641503133184:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 19644us (20425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936714.812018:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 132 00000100:00100000:3.0:1784936715.155501:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936715.155548:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ffa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524113024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936715.155651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936715.155753:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113024 00000100:00100000:3.0:1784936715.155763:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113024 00000100:00100000:3.0:1784936715.155821:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784936715.155832:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524113024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936715.155865:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784936715.155916:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524113024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936715.155924:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784936715.155997:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ffa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524113024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784936715.592732:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784936715.806623:0:11973:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936715.806639:0:11973:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936715.806709:0:11973:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784936715.806717:0:11973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784936716.061870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936716.074875:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503133824 00000100:00100000:1.0:1784936716.074898:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503133824 00000100:00100000:1.0:1784936716.075008:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 133 00000100:00100000:1.0:1784936716.075023:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+25:10588:x1871641503133824:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936716.075072:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936716.075282:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f61db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ec9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936716.075690:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f61e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936716.075710:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f61e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936716.075725:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f61e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936716.075740:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784936716.075924:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f61db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ec9 expref: 28 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936716.075946:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f61e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ec9 expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936716.075957:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:1.0:1784936716.075960:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784936716.075964:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165a00, rc 0) 00000100:00080000:0.0:1784936716.076139:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936716.077297:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:10588:x1871641503133824:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2266us (15431us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1784936716.077311:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 133 00000100:00100000:0.0:1784936716.085697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936716.085818:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503133952 00000100:00100000:2.0:1784936716.085833:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503133952 00000100:00100000:2.0:1784936716.085908:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 134 00000100:00100000:2.0:1784936716.085918:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+27:10588:x1871641503133952:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1784936716.086018:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086292:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086310:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086351:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086359:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086367:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086374:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936716.086378:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086387:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.086421:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:2.0:1784936716.087316:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936716.087332:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936716.087341:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f61f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936716.087497:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+27:10588:x1871641503133952:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 1575us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936716.087507:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 134 00000100:00100000:0.0:1784936716.227543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936716.227677:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134080 00000100:00100000:3.0:1784936716.227690:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134080 00000100:00100000:3.0:1784936716.227780:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:3.0:1784936716.227793:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503134080:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1784936716.227820:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936716.227850:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a46bace9/0x6cf7a864723f61f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ed0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936716.227884:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a63f909, atime: 0x6a63f909, ctime: 0x6a63f909, blocks: 0xb 00010000:00010000:3.0:1784936716.227913:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1784936716.227918:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936716.227940:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46bace9/0x6cf7a864723f61f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed0 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936716.228171:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a46bace9/0x6cf7a864723f61f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed0 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936716.228192:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4600, rc 0) 00000100:00100000:3.0:1784936716.228270:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503134080:12345-192.168.204.1@tcp:101:cat.0 Request processed in 481us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936716.228278:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00080000:0.0:1784936716.228474:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784936716.235412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936716.235465:0:6603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134208 00000100:00100000:3.0:1784936716.235477:0:6603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134208 00002000:00100000:3.0:1784936716.235543:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9096ec89b480 x1871641503134208/t0(0) o3->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:457/0 lens 488/0 e 0 to 0 dl 1784936727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936716.235557:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ec89b480 with x1871641503134208 ext(0->4095) 00002000:00010000:3.0:1784936716.235565:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096ec89b480 00000100:00100000:3.0:1784936716.235599:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:3.0:1784936716.235610:0:6603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503134208:12345-192.168.204.1@tcp:3:cat.0 00000100:00100000:3.0:1784936716.235907:0:6603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503134208:12345-192.168.204.1@tcp:3:cat.0 Request processed in 297us (510us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784936716.235916:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00002000:00100000:3.0:1784936716.235924:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9096ec89b480 x1871641503134208/t0(0) o3->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:457/0 lens 488/4536 e 0 to 0 dl 1784936727 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936716.235932:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ec89b480 with x1871641503134208 ext(0->4095) 00002000:00010000:3.0:1784936716.239053:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096ec89b480 00000001:00080000:0.0:1784936716.267270:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1784936716.267302:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1784936716.616703:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936716.684668:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524113280:0@lo:400:kworker.0 00000100:00100000:3.0:1784936716.684774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936716.684850:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524113792:0@lo:400:kworker.0 00000100:00100000:3.0:1784936716.684880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936716.684914:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784936716.684923:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524113408:0@lo:400:kworker.0 00000100:00100000:3.0:1784936716.684954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936716.684968:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524113920:0@lo:400:kworker.0 00000100:00100000:3.0:1784936716.684992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936716.685481:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524113152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936716.685521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936716.685572:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524113664:0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.685597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936716.685623:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784936716.685629:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ee3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524113536:0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.685663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936716.685707:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113792 00000100:00100000:1.0:1784936716.685716:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113792 00000100:00100000:1.0:1784936716.685776:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113408 00000100:00100000:1.0:1784936716.685779:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113408 00000100:00100000:1.0:1784936716.685802:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113536 00000100:00100000:1.0:1784936716.685805:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113536 00000100:00100000:1.0:1784936716.685822:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784936716.685831:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.685894:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524113792:12345-0@lo:400:kworker.0 Request processed in 63us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936716.685901:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784936716.685917:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784936716.685922:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.685959:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524113408:12345-0@lo:400:kworker.0 Request processed in 37us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936716.685965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784936716.685974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784936716.685980:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524113536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.686006:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524113536:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936716.686012:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784936716.686042:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113920 00000100:00100000:1.0:1784936716.686052:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113920 00000100:00100000:1.0:1784936716.686086:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113664 00000100:00100000:1.0:1784936716.686089:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113664 00000100:00100000:1.0:1784936716.686109:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784936716.686114:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.686146:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524113920:12345-0@lo:400:kworker.0 Request processed in 32us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936716.686152:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784936716.686161:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784936716.686166:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936716.686192:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524113664:12345-0@lo:400:kworker.0 Request processed in 26us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936716.686198:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784936716.687172:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524113536:0@lo:400:kworker.0 00000100:00100000:2.0:1784936716.687192:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524113664:0@lo:400:kworker.0 00000100:00100000:2.0:1784936716.687251:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524113408:0@lo:400:kworker.0 00000100:00100000:2.0:1784936716.687262:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1784936716.687267:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1784936716.687283:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096c593df80, transno 4294967304 00000100:00100000:2.0:1784936716.687296:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524113920:0@lo:400:kworker.0 00000100:00100000:2.0:1784936716.687308:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ee3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524113792:0@lo:400:kworker.0 00000100:00100000:0.0:1784936716.688606:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113280 00000100:00100000:0.0:1784936716.688626:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113280 00000100:00100000:0.0:1784936716.688710:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1784936716.688721:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524113280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936716.688848:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524113280:12345-0@lo:400:kworker.0 Request processed in 128us (4074us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936716.688856:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:0.0:1784936716.688894:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936716.688901:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936716.688905:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936716.689184:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524113152 00000100:00100000:3.0:1784936716.689191:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524113152 00000100:00100000:3.0:1784936716.689248:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784936716.689256:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524113152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936716.689294:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936716.689345:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524113152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936716.689351:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784936716.689417:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524113152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936716.689803:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524113280:0@lo:400:kworker.0 00000100:00100000:0.0:1784936717.250258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936717.250391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936717.250453:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936717.250481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936717.250505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936717.250554:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134592 00000100:00100000:0.0:1784936717.250569:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134592 00000100:00100000:0.0:1784936717.250650:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134720 00000100:00100000:0.0:1784936717.250654:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134720 00000100:00100000:0.0:1784936717.250701:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:0.0:1784936717.250712:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503134592:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936717.250809:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503134592:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 99us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936717.250818:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:0.0:1784936717.250838:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:0.0:1784936717.250844:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503134720:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936717.250894:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503134720:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 50us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936717.250901:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:0.0:1784936717.250921:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134848 00000100:00100000:0.0:1784936717.250924:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134848 00000100:00100000:0.0:1784936717.250955:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134464 00000100:00100000:0.0:1784936717.250958:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134464 00000100:00100000:0.0:1784936717.250979:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 139 00000100:00100000:0.0:1784936717.250985:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503134848:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936717.251032:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503134848:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 46us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936717.251039:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 139 00000100:00100000:0.0:1784936717.251051:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 140 00000100:00100000:0.0:1784936717.251057:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:2372:x1871641503134464:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936717.251082:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:2372:x1871641503134464:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936717.251088:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 140 00000100:00080000:0.0:1784936717.251114:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784936717.251120:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936717.258162:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134336 00000100:00100000:3.0:1784936717.258187:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134336 00000100:00100000:0.0:1784936717.258367:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 290 00000100:00100000:0.0:1784936717.258380:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503134336:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936717.258516:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503134336:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 138us (8273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936717.258525:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 290 00010000:00010000:0.0:1784936717.640687:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936718.664700:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784936718.856754:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784936718.856767:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784936718.856842:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784936718.856849:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784936719.689994:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784936719.839165:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1784936719.839217:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1784936719.839249:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096c8ac3a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1784936719.839257:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096c4d57a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096c8ac30c0 00000020:00080000:0.0:1784936719.839261:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096c4d57b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096d4720400 00000020:00080000:0.0:1784936719.839276:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1784936719.839576:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1784936719.929626:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1784936719.929652:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1784936720.265479:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524114048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936720.265602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936720.268508:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114048 00000100:00100000:0.0:1784936720.268532:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114048 00000100:00100000:0.0:1784936720.268648:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784936720.268663:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524114048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784936720.268719:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784936720.268945:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936720.280413:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1784936720.280446:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096c593e300, transno 4294967310 00000004:00080000:2.0:1784936720.280505:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1784936720.280562:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524114048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936720.281592:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524114048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12917us (15974us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936720.281606:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1784936720.714875:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936721.737754:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936721.801407:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936721.801457:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524114176:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.801527:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524114432:0@lo:400:kworker.0 00000100:00100000:0.0:1784936721.801581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936721.801643:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524114688:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.801727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936721.801822:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784936721.801829:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524114304:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.801855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936721.801875:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524114816:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.801904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936721.801969:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114176 00000100:00100000:1.0:1784936721.801980:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114176 00000100:00100000:1.0:1784936721.802047:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784936721.802059:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802139:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524114176:12345-0@lo:400:kworker.0 Request processed in 82us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936721.802149:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784936721.802194:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114432 00000100:00100000:1.0:1784936721.802199:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114432 00000100:00100000:1.0:1784936721.802245:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114304 00000100:00100000:1.0:1784936721.802249:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114304 00000100:00100000:1.0:1784936721.802271:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784936721.802278:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524114432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802314:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524114432:12345-0@lo:400:kworker.0 Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936721.802320:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784936721.802332:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784936721.802338:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524114304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802363:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524114304:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936721.802369:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784936721.802393:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114816 00000100:00100000:1.0:1784936721.802397:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114816 00000100:00100000:1.0:1784936721.802450:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784936721.802458:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524114816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802493:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524114816:12345-0@lo:400:kworker.0 Request processed in 36us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936721.802500:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1784936721.802521:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936721.802528:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936721.802545:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524114176:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802566:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524114944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936721.802586:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524114560:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936721.802628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936721.802641:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524114304:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802656:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524114816:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802670:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524114432:0@lo:400:kworker.0 00000100:00100000:0.0:1784936721.802688:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114560 00000100:00100000:0.0:1784936721.802695:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114560 00000100:00100000:1.0:1784936721.802702:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114944 00000100:00100000:1.0:1784936721.802707:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114944 00000100:00100000:0.0:1784936721.802734:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784936721.802741:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784936721.802746:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524114560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802753:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524114944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936721.802793:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524114560:12345-0@lo:400:kworker.0 Request processed in 50us (165us total) trans 0 rc 0/0 00002000:00000024:1.0:1784936721.802795:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784936721.802805:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784936721.802840:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524114560:0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.802850:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524114944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936721.802858:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784936721.802890:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524114944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936721.803217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936721.803683:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524114688 00000100:00100000:1.0:1784936721.803689:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524114688 00000100:00100000:1.0:1784936721.803750:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784936721.803759:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524114688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936721.803810:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524114688:12345-0@lo:400:kworker.0 Request processed in 54us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936721.803816:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1784936721.804052:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936721.804080:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524114688:0@lo:400:kworker.0 00000100:00100000:3.0:1784936722.013798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936722.014063:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503134976 00000100:00100000:1.0:1784936722.014082:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503134976 00000100:00100000:1.0:1784936722.014215:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00100000:1.0:1784936722.014228:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+14:10239:x1871641503134976:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1784936722.014279:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936722.014424:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+14:10239:x1871641503134976:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 Request processed in 198us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936722.014485:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 135 00000100:00100000:3.0:1784936722.017791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936722.017993:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503135232 00000100:00100000:2.0:1784936722.018014:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503135232 00000100:00100000:2.0:1784936722.018109:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:2.0:1784936722.018121:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+14:10239:x1871641503135232:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784936722.021308:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+15:10239:x1871641503135232:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1507us (1845us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1784936722.021331:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:2.0:1784936722.363271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936722.363327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936722.363387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936722.363480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936722.363509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936722.363631:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503135744 00000100:00100000:0.0:1784936722.363646:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503135744 00000100:00100000:3.0:1784936722.363702:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503135360 00000100:00100000:3.0:1784936722.363709:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503135360 00000100:00100000:0.0:1784936722.363744:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503135616 00000100:00100000:0.0:1784936722.363750:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503135616 00000100:00100000:3.0:1784936722.363753:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 292 00000100:00100000:3.0:1784936722.363767:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503135360:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936722.363803:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:0.0:1784936722.363815:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503135744:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936722.363861:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503135360:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 95us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936722.363862:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503135744:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 47us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936722.363876:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 292 00000100:00100000:0.0:1784936722.363883:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:0.0:1784936722.363906:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:0.0:1784936722.363914:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503135616:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936722.363941:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503135616:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936722.363948:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00080000:2.0:1784936722.364003:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936722.364009:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936722.364278:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503135488 00000100:00100000:1.0:1784936722.364285:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503135488 00000100:00100000:1.0:1784936722.364328:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503135872 00000100:00100000:1.0:1784936722.364332:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503135872 00000100:00100000:1.0:1784936722.364381:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 144 00000100:00080000:2.0:1784936722.364389:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936722.364391:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:2372:x1871641503135488:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936722.364468:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:2372:x1871641503135488:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 79us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936722.364475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 144 00000100:00100000:1.0:1784936722.364488:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:1.0:1784936722.364494:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503135872:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936722.364519:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503135872:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 24us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936722.364527:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:2.0:1784936722.370755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936722.378137:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136000 00000100:00100000:3.0:1784936722.378163:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136000 00000100:00100000:3.0:1784936722.378284:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 136 00000100:00100000:3.0:1784936722.382059:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:11041:x1871641503136000:12345-192.168.204.1@tcp:101:lsof.0 00010000:00010000:2.0:1784936722.389562:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936722.389610:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f61fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ed7 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936722.389737:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936722.389756:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936722.389776:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936722.390140:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784936722.390146:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936722.390774:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936722.390821:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f61fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 7 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936722.390845:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 6 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936722.390856:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:2.0:1784936722.390860:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784936722.390865:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19e00, rc 0) 00000100:00100000:2.0:1784936722.392790:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:11041:x1871641503136000:12345-192.168.204.1@tcp:101:lsof.0 Request processed in 14474us (22028us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936722.392808:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 136 00010000:00010000:0.0:1784936722.763030:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936723.785178:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936724.808931:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784936724.951916:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1784936724.951954:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1784936724.951970:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1784936724.951982:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1784936725.386635:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524115072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936725.386753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936725.388785:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115072 00000100:00100000:1.0:1784936725.388806:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115072 00000100:00100000:1.0:1784936725.388934:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784936725.388948:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524115072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936725.389011:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784936725.390276:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936725.396181:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524115072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936725.396182:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524115072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7157us (9348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936725.396201:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1784936725.833570:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784936726.511369:0:12175:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:45:24 (1784936724) 00010000:00010000:3.0:1784936726.856966:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936726.922305:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524115456:0@lo:400:kworker.0 00000100:00100000:1.0:1784936726.922378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936726.922492:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784936726.922499:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524115328:0@lo:400:kworker.0 00000100:00100000:1.0:1784936726.922525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936726.922541:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524115840:0@lo:400:kworker.0 00000100:00100000:1.0:1784936726.922567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936726.922656:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524115584:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.922689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936726.922715:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784936726.922721:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524115200:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.922761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936726.922784:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524115712:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.922805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936726.922833:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115456 00000100:00100000:0.0:1784936726.922839:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115456 00000100:00100000:0.0:1784936726.922890:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115328 00000100:00100000:0.0:1784936726.922893:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115328 00000100:00100000:0.0:1784936726.922907:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115712 00000100:00100000:0.0:1784936726.922910:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115712 00000100:00100000:0.0:1784936726.922930:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784936726.922939:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524115456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923001:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524115456:12345-0@lo:400:kworker.0 Request processed in 62us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936726.923009:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784936726.923028:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784936726.923035:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524115328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923064:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524115328:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936726.923070:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784936726.923082:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784936726.923089:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524115712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923121:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524115712:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936726.923142:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784936726.923162:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115840 00000100:00100000:0.0:1784936726.923166:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115840 00000100:00100000:0.0:1784936726.923191:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115584 00000100:00100000:0.0:1784936726.923194:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115584 00000100:00100000:0.0:1784936726.923210:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784936726.923215:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524115840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923246:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524115840:12345-0@lo:400:kworker.0 Request processed in 31us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936726.923252:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784936726.923263:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784936726.923269:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524115584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923295:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524115584:12345-0@lo:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936726.923300:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784936726.923320:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115200 00000100:00100000:0.0:1784936726.923324:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115200 00000100:00100000:0.0:1784936726.923348:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784936726.923354:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524115200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923383:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524115200:12345-0@lo:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936726.923388:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1784936726.923418:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936726.923423:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936726.923507:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524115200:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923521:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524115712:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923539:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524115584:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923572:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524115328:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923581:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524115840:0@lo:400:kworker.0 00000100:00100000:0.0:1784936726.923590:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524115456:0@lo:400:kworker.0 00000100:00100000:2.0:1784936726.924665:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784936726.932793:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524115968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936726.932879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936726.933078:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524115968 00000100:00100000:3.0:1784936726.933086:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524115968 00000100:00100000:3.0:1784936726.933144:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784936726.933155:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524115968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936726.933191:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936726.933245:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524115968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936726.933252:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784936726.933587:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524115968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936727.481683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936727.481729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936727.481784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936727.481826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936727.481861:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936727.481892:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136512 00000100:00100000:1.0:1784936727.481902:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136512 00000100:00100000:1.0:1784936727.481959:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136384 00000100:00100000:1.0:1784936727.481962:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136384 00000100:00100000:1.0:1784936727.481985:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:1.0:1784936727.481995:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503136512:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936727.482067:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503136512:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936727.482075:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:1.0:1784936727.482093:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:1.0:1784936727.482112:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503136384:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936727.482158:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503136384:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936727.482164:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:3.0:1784936727.482601:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136128 00000100:00100000:3.0:1784936727.482607:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136128 00000100:00100000:3.0:1784936727.482649:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 294 00000100:00100000:3.0:1784936727.482664:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503136128:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936727.482693:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503136128:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 31us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936727.482699:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 294 00000100:00100000:0.0:1784936727.482860:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136256 00000100:00100000:0.0:1784936727.482865:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136256 00000100:00100000:0.0:1784936727.482903:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136640 00000100:00100000:0.0:1784936727.482906:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136640 00000100:00100000:0.0:1784936727.482928:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 149 00000100:00100000:0.0:1784936727.482935:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:2373:x1871641503136256:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936727.482967:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:2373:x1871641503136256:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 33us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936727.482975:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 149 00000100:00100000:0.0:1784936727.482987:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:0.0:1784936727.482993:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2373:x1871641503136640:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936727.483016:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2373:x1871641503136640:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 23us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936727.483022:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00080000:0.0:1784936727.483039:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784936727.483043:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936727.483045:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784936727.880661:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784936728.072729:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784936728.072740:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784936728.073199:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1784936728.073210:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784936728.219280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936728.219380:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503136896 00000100:00100000:1.0:1784936728.219390:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503136896 00000100:00100000:1.0:1784936728.219494:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 137 00000100:00100000:1.0:1784936728.219505:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:11306:x1871641503136896:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936728.219527:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936728.219547:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f620c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ede expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.219624:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.219639:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.219652:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.219667:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.219675:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.219681:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220220:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6221 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220237:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6221 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220244:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6221 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936728.220254:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784936728.220485:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220493:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220500:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220506:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936728.220511:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220519:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220533:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:1.0:1784936728.220535:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936728.220539:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220545:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6213 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220555:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220568:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220575:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220580:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936728.220583:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220589:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220597:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9096c7246f00) 00010000:00010000:1.0:1784936728.220599:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936728.220601:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220606:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f621a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220979:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f620c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ede expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.220994:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6221 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ede expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936728.221001:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:1.0:1784936728.221004:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936728.221012:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164e00, rc 0) 00000100:00100000:1.0:1784936728.221098:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+16:11306:x1871641503136896:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1593us (1825us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784936728.221106:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 137 00000100:00100000:3.0:1784936728.224845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936728.225208:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137024 00000100:00100000:0.0:1784936728.225217:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137024 00000100:00100000:0.0:1784936728.225281:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 138 00000100:00100000:0.0:1784936728.225292:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+16:11306:x1871641503137024:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1784936728.225411:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+16:11306:x1871641503137024:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 Request processed in 121us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936728.225418:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 138 00000100:00100000:3.0:1784936728.226198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936728.226534:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137152 00000100:00100000:2.0:1784936728.226542:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137152 00000100:00100000:2.0:1784936728.226594:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:2.0:1784936728.226602:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+16:2373:x1871641503137152:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936728.226617:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936728.226643:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6221 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ede expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936728.226670:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:2.0:1784936728.226675:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936728.226714:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+15:2373:x1871641503137152:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 113us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936728.226732:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:3.0:1784936728.904861:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784936729.097769:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936729.097780:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784936729.098336:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1784936729.098345:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784936729.933013:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784936730.068504:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1784936730.100401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.100532:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137280 00000100:00100000:1.0:1784936730.100542:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137280 00000100:00100000:1.0:1784936730.100605:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 139 00000100:00100000:1.0:1784936730.100617:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:11348:x1871641503137280:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936730.100639:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.100662:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f622f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ee5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.100746:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.100762:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.100788:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.100804:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.100812:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.100820:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101204:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101220:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101227:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101234:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936730.101239:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101247:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101261:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:1.0:1784936730.101264:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936730.101269:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101275:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101287:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101294:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101300:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101306:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936730.101315:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101322:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101332:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9096c7246f00) 00010000:00010000:1.0:1784936730.101334:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936730.101338:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101344:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f623d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101379:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f622f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ee5 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101403:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:1.0:1784936730.101406:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936730.101410:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f622f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ee5 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.101419:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164e00, rc 0) 00000100:00100000:1.0:1784936730.101502:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:11348:x1871641503137280:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 887us (1122us total) trans 0 rc 301/301 00000100:00100000:1.0:1784936730.101508:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 139 00000100:00080000:0.0:1784936730.102881:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936730.114958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.115336:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137536 00000100:00100000:1.0:1784936730.115347:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137536 00000100:00100000:1.0:1784936730.115481:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 140 00000100:00100000:1.0:1784936730.115493:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+14:11348:x1871641503137536:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:1.0:1784936730.115563:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936730.115591:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f5bad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d1e expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.115608:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:1.0:1784936730.115613:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936730.116240:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.116259:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 5 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.116268:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.116304:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 5 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.116321:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 5 pid: 6621 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.116338:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524116096:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936730.116477:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c93720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936730.123200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.123340:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137664 00000100:00100000:0.0:1784936730.123350:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137664 00010000:00010000:0.0:1784936730.123425:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 6 pid: 6621 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936730.123483:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:0.0:1784936730.123493:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d464a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2372:x1871641503137664:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936730.123509:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936730.123516:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 6 pid: 6621 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.123531:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 6 pid: 6621 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.123569:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:0.0:1784936730.123575:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.123586:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.123593:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.123613:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936730.123660:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d464a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2372:x1871641503137664:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 168us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936730.123668:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00080000:2.0:1784936730.123807:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784936730.124987:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6205 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed7 expref: 5 pid: 6621 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936730.125006:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524116096:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936730.125028:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.125044:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.125050:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.125074:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.125084:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.125093:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936730.126487:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1784936730.126501:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.126509:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.126515:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.126521:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936730.126526:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.126533:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.126558:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096d7e59100) 00010000:00010000:2.0:1784936730.126561:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936730.126566:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.126572:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6244 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936730.126590:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e48f93e reply state 00000000fe9372cb transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936730.126599:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936730.126692:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+15:11348:x1871641503137536:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 11189us (11732us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1784936730.126701:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 140 00010000:00010000:1.0:1784936730.143003:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.143022:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.143044:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.143051:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936730.143056:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.143064:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.143079:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9096d7e59a00) 00010000:00010000:1.0:1784936730.143083:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936730.143088:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.143094:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f624b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936730.236244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.236470:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137792 00000100:00100000:1.0:1784936730.236482:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137792 00000100:00100000:1.0:1784936730.236775:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 141 00000100:00100000:1.0:1784936730.236786:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+14:11356:x1871641503137792:12345-192.168.204.1@tcp:101:lctl.0 00010000:00010000:1.0:1784936730.236812:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.236837:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94eec expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.236915:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6259 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.236948:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.236960:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936730.237033:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784936730.237038:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936730.237069:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6259 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.237094:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eec expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.237115:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6259 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eec expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.237123:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:1.0:1784936730.237126:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936730.237129:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164a00, rc 0) 00000100:00100000:1.0:1784936730.237208:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+15:11356:x1871641503137792:12345-192.168.204.1@tcp:101:lctl.0 Request processed in 424us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.237216:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 141 00000100:00100000:0.0:1784936730.303329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.306023:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503137920 00000100:00100000:1.0:1784936730.306038:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503137920 00000100:00100000:2.0:1784936730.308096:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 142 00000100:00100000:2.0:1784936730.308110:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+15:11362:x1871641503137920:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936730.308134:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936730.308158:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ef3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308229:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308244:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308258:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308291:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308300:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308307:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308477:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f6275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308486:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f6275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308492:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f6275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936730.308526:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1784936730.308530:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936730.308554:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f6275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308569:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308575:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308583:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308599:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936730.308603:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308611:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308623:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:2.0:1784936730.308626:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936730.308631:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308637:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308649:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308656:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308661:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308665:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936730.308667:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308673:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308690:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9096d7e59100) 00010000:00010000:2.0:1784936730.308693:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936730.308696:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308702:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f626e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308732:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ef3 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308746:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f6275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ef3 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.308753:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936730.308755:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784936730.308757:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19600, rc 0) 00000100:00100000:2.0:1784936730.308840:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+16:11362:x1871641503137920:12345-192.168.204.1@tcp:101:bash.0 Request processed in 732us (5520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936730.308848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 142 00000100:00100000:2.0:1784936730.313695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.315528:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503138176 00000100:00100000:0.0:1784936730.315542:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503138176 00000100:00100000:0.0:1784936730.315612:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 143 00000100:00100000:0.0:1784936730.315624:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+16:11362:x1871641503138176:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936730.315645:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936730.315668:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f627c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94efa expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.315882:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.315897:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.315930:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.315982:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.315991:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.315998:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784936730.316753:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1784936730.316936:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.316947:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.316957:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.316993:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317002:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317009:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317015:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936730.317029:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317037:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317051:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:0.0:1784936730.317054:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936730.317059:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317065:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6283 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936730.317078:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e033ebb2 reply state 00000000153acb0a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936730.317086:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784936730.317117:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f627c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317131:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.317138:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:0.0:1784936730.317140:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936730.317142:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b000, rc 0) 00000100:00100000:0.0:1784936730.317227:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+19:11362:x1871641503138176:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1605us (3541us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1784936730.317235:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 143 00010000:00010000:0.0:1784936730.319189:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.319206:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.319214:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.319221:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936730.319225:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.319232:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.319248:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096caf90000) 00010000:00010000:0.0:1784936730.319251:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936730.319257:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.319263:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f628a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936730.321484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.321579:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503138304 00000100:00100000:1.0:1784936730.321590:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503138304 00000100:00100000:1.0:1784936730.321674:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:1.0:1784936730.321693:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503138304:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936730.321727:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.321748:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f01 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784936730.321773:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784936730.321797:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1784936730.321802:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936730.321812:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.321830:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.321845:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165000, rc 0) 00000100:00100000:1.0:1784936730.321903:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503138304:12345-192.168.204.1@tcp:101:bash.0 Request processed in 213us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.321910:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00080000:2.0:1784936730.321980:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936730.325119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.325339:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503138432 00000100:00100000:1.0:1784936730.325348:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503138432 00000100:00100000:1.0:1784936730.325421:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:1.0:1784936730.325463:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:11362:x1871641503138432:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936730.325483:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.325502:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f08 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.325536:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.325558:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936730.325563:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936730.325569:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.325607:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.325624:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.325638:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6597:1871641524116224:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936730.325742:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936730.328756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.328868:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6597:1871641524116224:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936730.328902:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.328923:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164400, rc 0) 00000100:00100000:1.0:1784936730.328984:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:11362:x1871641503138432:12345-192.168.204.1@tcp:101:bash.0 Request processed in 3523us (3873us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.328992:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:3.0:1784936730.329197:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503138560 00000100:00100000:3.0:1784936730.329204:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503138560 00010000:00010000:3.0:1784936730.329237:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936730.329274:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:3.0:1784936730.329282:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503138560:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936730.329295:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936730.329316:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.329331:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.329354:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002af666e/0x6cf7a864723f629f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f01 expref: 7 pid: 6598 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.329400:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936730.329405:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936730.329414:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.329450:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.329488:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936730.329503:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5781:1871641524116352:192.168.204.1@tcp:105: 00000100:00100000:3.0:1784936730.329567:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb2300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936730.332904:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5781:1871641524116352:192.168.204.1@tcp:105: 00010000:00010000:3.0:1784936730.332934:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936730.332994:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503138560:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 3711us (4246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936730.333004:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:2.0:1784936730.335619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.336079:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503138816 00000100:00100000:0.0:1784936730.336088:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503138816 00000100:00100000:0.0:1784936730.336149:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:0.0:1784936730.336159:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+18:11362:x1871641503138816:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:0.0:1784936730.336574:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+19:11362:x1871641503138816:12345-192.168.204.1@tcp:35:bash.0 Request processed in 414us (962us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1784936730.336599:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:2.0:1784936730.413980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.414097:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503139072 00000100:00100000:0.0:1784936730.414109:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503139072 00000100:00100000:0.0:1784936730.414179:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 144 00000100:00100000:0.0:1784936730.414190:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+19:11372:x1871641503139072:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936730.414215:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936730.414235:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f0f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936730.414357:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784936730.414526:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f0f expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.414542:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:0.0:1784936730.414545:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936730.414550:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f0f expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.414563:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b800, rc 0) 00000100:00100000:0.0:1784936730.414621:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+20:11372:x1871641503139072:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 433us (650us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1784936730.414629:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 144 00000100:00100000:3.0:1784936730.417862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.418150:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503139328 00000100:00100000:0.0:1784936730.418160:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503139328 00000100:00100000:0.0:1784936730.418207:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:0.0:1784936730.418217:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+20:11372:x1871641503139328:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936730.418534:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+21:11372:x1871641503139328:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 317us (681us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784936730.418543:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:2.0:1784936730.487055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.487169:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503139456 00000100:00100000:1.0:1784936730.487180:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503139456 00000100:00100000:1.0:1784936730.487242:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:1.0:1784936730.487270:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+21:11378:x1871641503139456:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936730.487299:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.487323:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f62bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f16 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.487405:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f62c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.487420:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f62c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.487460:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f62c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936730.487523:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1784936730.487526:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936730.487548:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f62c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.487573:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f62bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f16 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.487592:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f62c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f16 expref: 22 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.487600:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936730.487603:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936730.487606:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:1.0:1784936730.487725:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+22:11378:x1871641503139456:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 457us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.487741:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 145 00000100:00100000:2.0:1784936730.492237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.492334:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503139712 00000100:00100000:0.0:1784936730.492343:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503139712 00000100:00100000:0.0:1784936730.492501:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 146 00000100:00100000:0.0:1784936730.492512:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+22:11378:x1871641503139712:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936730.492537:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936730.492557:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f1d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.492678:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f62d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.492693:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f62d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.492705:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f62d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936730.492717:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784936730.492854:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f1d expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.492873:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f62d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f1d expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.492882:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:0.0:1784936730.492897:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936730.492901:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a600, rc 0) 00000100:00100000:0.0:1784936730.492967:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+24:11378:x1871641503139712:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 457us (741us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1784936730.492975:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 146 00000100:00100000:3.0:1784936730.496506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.496646:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503139968 00000100:00100000:1.0:1784936730.496657:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503139968 00000100:00100000:1.0:1784936730.496732:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 147 00000100:00100000:1.0:1784936730.496741:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+24:11378:x1871641503139968:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936730.496777:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.496799:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f62de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f24 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.496917:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f62e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.496932:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f62e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.496942:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f62e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936730.496954:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784936730.497074:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f62de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f24 expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.497094:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f62e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f24 expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.497102:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:1.0:1784936730.497105:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784936730.497108:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165800, rc 0) 00000100:00100000:1.0:1784936730.497175:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+26:11378:x1871641503139968:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 433us (681us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1784936730.497182:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 147 00000100:00100000:2.0:1784936730.500080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.500249:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140096 00000100:00100000:0.0:1784936730.500258:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140096 00000100:00100000:0.0:1784936730.500314:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1784936730.500324:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+26:2373:x1871641503140096:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936730.500340:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936730.500364:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f62d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f1d expref: 26 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.500395:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:0.0:1784936730.500401:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936730.500519:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+25:2373:x1871641503140096:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 196us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936730.500527:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:0.0:1784936730.508295:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524116480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936730.508369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936730.508776:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524116480 00000100:00100000:1.0:1784936730.508784:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524116480 00000100:00100000:1.0:1784936730.508855:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784936730.508864:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524116480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936730.508904:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784936730.510135:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936730.510476:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524116480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1608us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.510488:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784936730.510835:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.510891:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140224 00000100:00100000:1.0:1784936730.510900:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140224 00000100:00100000:1.0:1784936730.510952:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:1.0:1784936730.510961:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503140224:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:1.0:1784936730.511005:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.511027:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.511036:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936730.511040:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784936730.511044:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.511080:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.511112:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 6 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.511127:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6598:1871641524116608:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936730.511260:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524116480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936730.511908:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372000 going to sleep for 11 seconds 00000100:00100000:3.0:1784936730.515296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936730.515332:0:6603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140352 00000100:00100000:3.0:1784936730.515342:0:6603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140352 00002000:00100000:3.0:1784936730.515405:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9096fba48380 x1871641503140352/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:471/0 lens 504/0 e 0 to 0 dl 1784936741 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936730.515448:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fba48380 with x1871641503140352 ext(0->12) 00010000:00010000:3.0:1784936730.515459:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 7 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.515478:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 7 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936730.515487:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9096fba48380 00000100:00100000:3.0:1784936730.515518:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:3.0:1784936730.515529:0:6603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503140352:12345-192.168.204.1@tcp:4:lfs.0 00000100:00100000:3.0:1784936730.516059:0:6603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503140352:12345-192.168.204.1@tcp:4:lfs.0 Request processed in 529us (771us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784936730.516067:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00002000:00100000:3.0:1784936730.516076:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9096fba48380 x1871641503140352/t4294967305(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:471/0 lens 504/448 e 0 to 0 dl 1784936741 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936730.516084:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fba48380 with x1871641503140352 ext(0->12) 00010000:00010000:3.0:1784936730.516091:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 9 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.516104:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 9 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936730.516111:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9096fba48380 00000100:00100000:1.0:1784936730.516247:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6598:1871641524116608:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936730.516277:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.520141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936730.520225:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140480 00000100:00100000:3.0:1784936730.520253:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140480 00010000:00010000:3.0:1784936730.520295:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 9 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936730.520340:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:3.0:1784936730.520351:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2374:x1871641503140480:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936730.520369:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784936730.520403:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784936730.520406:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784936730 00002000:00010000:3.0:1784936730.520408:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784936730 00002000:00010000:3.0:1784936730.520411:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784936730 00010000:00010000:3.0:1784936730.520418:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 9 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.520573:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 9 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.520603:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f62a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f08 expref: 9 pid: 6597 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.520621:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936730.520625:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936730.520632:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.520643:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.520927:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936730.520991:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2374:x1871641503140480:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 640us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936730.520999:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00010000:00010000:1.0:1784936730.522223:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522244:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522287:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522297:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522307:0:6598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522337:0:6598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936730.522342:0:6598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522352:0:6598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522371:0:6598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.522379:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9169ec3/0x6cf7a864723f62f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.523603:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503140224:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 12630us (12759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.523618:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:1.0:1784936730.526864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936730.526960:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140736 00000100:00100000:0.0:1784936730.526970:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140736 00000100:00100000:0.0:1784936730.527056:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:0.0:1784936730.527067:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8810050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+25:11378:x1871641503140736:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:0.0:1784936730.527134:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f62e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f24 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936730.527411:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1784936730.527495:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1784936730.528037:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1784936730.528094:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.528110:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.528119:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.528154:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936730.528172:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 29 pid: 5798 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936730.528187:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1871641524116736:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936730.528271:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936730.532126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.532395:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140864 00000100:00100000:1.0:1784936730.532406:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140864 00010000:00010000:1.0:1784936730.532488:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 30 pid: 5798 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.532523:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:1.0:1784936730.532532:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+30:2371:x1871641503140864:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936730.532547:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936730.532567:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 30 pid: 5798 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.532584:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 30 pid: 5798 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.532607:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:1.0:1784936730.532612:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.532622:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.532630:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.532650:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936730.532719:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+30:2371:x1871641503140864:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 187us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.532727:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00010000:00010000:2.0:1784936730.534120:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94efa expref: 29 pid: 5798 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936730.534140:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1871641524116736:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936730.534166:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.534177:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.534183:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936730.534312:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1784936730.534654:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1784936730.535159:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524116864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784936730.535222:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936730.535310:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9377f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936730.535358:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524116864 00000100:00100000:0.0:1784936730.535366:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524116864 00000100:00100000:0.0:1784936730.535499:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784936730.535508:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1871641524116864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784936730.535586:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1871641524116864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936730.535609:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784936730.535713:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524116864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784936730.536190:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1784936730.536256:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524116992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784936730.536290:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936730.536320:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9377000 going to sleep for 11 seconds 00000100:00100000:0.0:1784936730.536538:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524116992 00000100:00100000:0.0:1784936730.536544:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524116992 00000100:00100000:0.0:1784936730.536568:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784936730.536575:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1871641524116992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784936730.536743:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5799:x1871641524116992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 168us (451us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784936730.536764:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784936730.537008:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524116992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784936730.537059:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1784936730.537099:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.537122:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.537130:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.537137:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936730.537141:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.537150:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.537165:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:2.0:1784936730.537168:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784936730.537173:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.537178:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f62fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784936730.537348:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784936730.537510:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1784936730.537521:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396289092676ns, next at 397289090096ns, rc = 0 00000001:00080000:2.0:1784936730.537527:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1784936730.537562:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096caf90600) 00010000:00010000:2.0:1784936730.537566:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784936730.537573:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f62e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f24 expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936730.537704:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8810050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+32:11378:x1871641503140736:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 10638us (10850us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1784936730.537712:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000020:00080000:2.0:1784936730.537717:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1784936730.543716:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936730.544111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.544199:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503140992 00000100:00100000:1.0:1784936730.544209:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503140992 00000100:00100000:1.0:1784936730.544273:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 148 00000100:00100000:1.0:1784936730.544284:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+32:11378:x1871641503140992:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936730.544309:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.544332:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f6301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f2b expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.544407:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f6301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f2b expref: 33 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.544467:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f6301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f2b expref: 33 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.544490:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936730.544493:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936730.544497:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165400, rc 0) 00000100:00100000:1.0:1784936730.544556:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+33:11378:x1871641503140992:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 273us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.544563:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 148 00000100:00100000:0.0:1784936730.548116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.548295:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503141248 00000100:00100000:1.0:1784936730.548306:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503141248 00000100:00100000:1.0:1784936730.548359:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:1.0:1784936730.548367:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+33:11378:x1871641503141248:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1784936730.548636:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+34:11378:x1871641503141248:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 268us (529us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1784936730.548644:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:3.0:1784936730.629352:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.629476:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503141504 00000100:00100000:1.0:1784936730.629488:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503141504 00000100:00100000:1.0:1784936730.629561:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 149 00000100:00100000:1.0:1784936730.629572:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+34:11388:x1871641503141504:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936730.629600:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.629626:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f6308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f32 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936730.629786:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1784936730.629936:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f6308 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f32 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.629951:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:1.0:1784936730.629954:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936730.629960:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f6308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f32 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.629976:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165200, rc 0) 00000100:00100000:1.0:1784936730.630043:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+35:11388:x1871641503141504:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 473us (701us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1784936730.630051:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 149 00000100:00100000:1.0:1784936730.633754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936730.633847:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503141632 00000100:00100000:3.0:1784936730.633857:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503141632 00000100:00100000:3.0:1784936730.633904:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:3.0:1784936730.633913:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+35:11388:x1871641503141632:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:3.0:1784936730.633991:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634007:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634019:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634035:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634042:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634048:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634167:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634190:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634198:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936730.634242:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634256:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634264:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634270:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634277:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936730.634281:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634288:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634300:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936730.634303:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936730.634308:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634313:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634334:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634340:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634345:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634350:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936730.634353:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634359:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634366:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173aa00) 00010000:00010000:3.0:1784936730.634368:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936730.634371:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634376:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f631d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634424:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634479:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634485:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634495:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936730.634499:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634505:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634514:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:3.0:1784936730.634515:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936730.634518:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.634524:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936730.634617:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+35:11388:x1871641503141632:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 703us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936730.634626:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 150 00000100:00100000:0.0:1784936730.638163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.638307:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503141888 00000100:00100000:1.0:1784936730.638317:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503141888 00000100:00100000:1.0:1784936730.638371:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:1.0:1784936730.638393:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+35:11388:x1871641503141888:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1784936730.638693:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+36:11388:x1871641503141888:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 312us (539us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1784936730.638700:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:1.0:1784936730.674070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936730.674234:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503142144 00000100:00100000:3.0:1784936730.674243:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503142144 00000100:00100000:3.0:1784936730.674308:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 151 00000100:00100000:3.0:1784936730.674318:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+36:11391:x1871641503142144:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936730.674343:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936730.674364:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f632b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f39 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674505:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674541:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674553:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674570:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674577:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674584:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674725:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674734:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674741:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936730.674764:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784936730.674862:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674871:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674878:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674890:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936730.674895:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674904:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674917:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936730.674920:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936730.674924:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674930:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674943:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674950:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674956:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674962:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936730.674964:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674970:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674986:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173aa00) 00010000:00010000:3.0:1784936730.674989:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936730.674991:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.674996:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.675050:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f632b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.675063:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936730.675071:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:3.0:1784936730.675075:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936730.675077:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936730.675290:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+38:11391:x1871641503142144:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 972us (1230us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1784936730.675298:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 151 00000100:00100000:3.0:1784936730.680552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.680712:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503142272 00000100:00100000:1.0:1784936730.680723:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503142272 00000100:00100000:1.0:1784936730.680794:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 152 00000100:00100000:1.0:1784936730.680805:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+38:11391:x1871641503142272:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:1.0:1784936730.680885:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680920:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680934:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680962:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680969:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680977:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680984:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936730.680987:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.680995:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.681007:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936730.681010:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936730.681014:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.681021:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f634e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936730.681103:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+38:11391:x1871641503142272:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 299us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936730.681117:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 152 00000100:00100000:2.0:1784936730.683706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.683977:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503142528 00000100:00100000:1.0:1784936730.683987:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503142528 00000100:00100000:1.0:1784936730.684038:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:1.0:1784936730.684048:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+38:11391:x1871641503142528:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:1.0:1784936730.684295:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ffa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+39:11391:x1871641503142528:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 247us (598us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1784936730.684303:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00010000:00010000:3.0:1784936730.952682:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936730.961136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936730.961247:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503142784 00000100:00100000:1.0:1784936730.961259:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503142784 00000100:00100000:1.0:1784936730.961326:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 153 00000100:00100000:1.0:1784936730.961336:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+39:11422:x1871641503142784:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:1.0:1784936730.961363:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936730.961398:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f6355 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f40 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.961572:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f635c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.961587:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f635c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.961599:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f635c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936730.961611:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784936730.961894:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f6355 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f40 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.961934:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f635c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f40 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936730.961943:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936730.961946:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936730.961950:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165800, rc 0) 00000100:00100000:1.0:1784936730.962016:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+41:11422:x1871641503142784:12345-192.168.204.1@tcp:101:cat.0 Request processed in 680us (890us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1784936730.962024:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 153 00000100:00100000:3.0:1784936730.966793:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936730.966836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936730.966935:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503143168 00000100:00100000:2.0:1784936730.966948:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503143168 00000100:00100000:2.0:1784936730.967028:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:2.0:1784936730.967038:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+41:2371:x1871641503143168:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936730.967054:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936730.967081:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f635c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f40 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936730.967103:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:2.0:1784936730.967108:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936730.967174:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+40:2371:x1871641503143168:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936730.967181:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1784936730.967815:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503143040 00000100:00100000:1.0:1784936730.967824:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503143040 00000100:00100000:1.0:1784936730.967868:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:1.0:1784936730.967877:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+40:11422:x1871641503143040:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:1.0:1784936730.968356:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+41:11422:x1871641503143040:12345-192.168.204.1@tcp:35:cat.0 Request processed in 479us (1573us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784936730.968365:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:3.0:1784936731.031135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.032395:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503143424 00000100:00100000:1.0:1784936731.032414:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503143424 00000100:00100000:1.0:1784936731.032529:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 154 00000100:00100000:1.0:1784936731.032543:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+41:11428:x1871641503143424:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:1.0:1784936731.032573:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936731.032577:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784936731.032605:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f62c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f16 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.032644:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936731.032649:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936731.032663:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f636a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f47 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.032784:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.032800:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.032812:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.032847:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.032863:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 41 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936731.032881:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0115f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524117120:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936731.033061:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372180 going to sleep for 11 seconds 00000100:00100000:2.0:1784936731.035699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.035832:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0115f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524117120:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936731.035862:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936731.037817:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503143552 00000100:00100000:0.0:1784936731.037830:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503143552 00010000:00010000:0.0:1784936731.037879:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 42 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936731.037983:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:0.0:1784936731.037994:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+42:2372:x1871641503143552:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936731.038013:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936731.038021:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 42 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.038037:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 42 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.038059:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f6340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f39 expref: 42 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.038102:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936731.038109:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.038118:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.038125:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.038157:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936731.038224:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+41:2372:x1871641503143552:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 231us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936731.038231:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00010000:00010000:1.0:1784936731.038609:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.038625:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936731.038653:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784936731.038839:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f636a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 42 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.038858:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 41 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.038866:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936731.038868:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784936731.038871:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164400, rc 0) 00000100:00100000:1.0:1784936731.038948:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+41:11428:x1871641503143424:12345-192.168.204.1@tcp:101:dd.0 Request processed in 6410us (7823us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1784936731.038959:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 154 00000100:00100000:2.0:1784936731.042882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.042944:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503143808 00000100:00100000:0.0:1784936731.042962:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503143808 00000100:00100000:0.0:1784936731.043022:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 155 00000100:00100000:0.0:1784936731.043032:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+41:11428:x1871641503143808:12345-192.168.204.1@tcp:36:dd.0 00010000:00010000:0.0:1784936731.043306:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.043323:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.043336:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936731.043402:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1784936731.045717:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb68dbb5 reply state 00000000a06544ae transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936731.045753:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936731.045893:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+44:11428:x1871641503143808:12345-192.168.204.1@tcp:36:dd.0 Request processed in 2857us (3016us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784936731.045902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 155 00000020:00080000:0.0:1784936731.045907:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784936731.057916:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.058829:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.058839:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.058845:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936731.058850:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.058880:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.058899:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936731.058902:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936731.058908:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.058914:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f637f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.352870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.352995:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503143936 00000100:00100000:0.0:1784936731.353006:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503143936 00000100:00100000:0.0:1784936731.353196:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 156 00000100:00100000:0.0:1784936731.353207:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+43:11442:x1871641503143936:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:0.0:1784936731.353233:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936731.353272:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6386 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f4e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353339:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353353:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353364:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353391:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353398:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353405:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353543:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353555:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 44 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353564:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353599:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 44 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.353616:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 44 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936731.353630:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524117248:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936731.354175:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936731.358559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.359159:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524117248:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936731.359192:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.360634:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503144192 00000100:00100000:2.0:1784936731.360648:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503144192 00000100:00100000:2.0:1784936731.360729:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:2.0:1784936731.360741:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+45:5589:x1871641503144192:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784936731.361123:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+46:5589:x1871641503144192:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 382us (2575us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1784936731.361130:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1784936731.364398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.364637:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503144320 00000100:00100000:1.0:1784936731.364647:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503144320 00010000:00010000:1.0:1784936731.364706:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 46 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936731.364761:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:1.0:1784936731.364772:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4648850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+46:2372:x1871641503144320:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936731.364787:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936731.364794:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 46 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.364810:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 46 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.364831:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6371 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f47 expref: 46 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.364859:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936731.364865:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.364874:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.364882:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.364904:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936731.364960:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4648850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+45:2372:x1871641503144320:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 189us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936731.364968:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00010000:00010000:0.0:1784936731.365130:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365139:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936731.365187:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784936731.365199:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936731.365226:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365252:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365262:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365268:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365275:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365281:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936731.365285:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365293:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365303:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:0.0:1784936731.365306:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936731.365310:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365316:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f638d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365327:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365346:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365352:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365356:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936731.365360:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365375:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365383:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096caf90100) 00010000:00010000:0.0:1784936731.365386:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936731.365388:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365394:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f6394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365481:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f6386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f4e expref: 45 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365495:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f4e expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.365503:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936731.365505:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936731.365514:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ae00, rc 0) 00000100:00100000:0.0:1784936731.365542:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+44:11442:x1871641503143936:12345-192.168.204.1@tcp:101:stat.0 Request processed in 12338us (12683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936731.365549:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 156 00000100:00100000:0.0:1784936731.438856:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.439172:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503144576 00000100:00100000:1.0:1784936731.439183:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503144576 00000100:00100000:1.0:1784936731.439304:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 157 00000100:00100000:1.0:1784936731.439315:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+44:11448:x1871641503144576:12345-192.168.204.1@tcp:36:truncate.0 00010000:00010000:1.0:1784936731.439395:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936731.439423:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f639b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f4e expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.440773:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936731.440779:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936731.441159:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.441176:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.441201:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936731.441257:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1784936731.441283:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bed5b2d3 reply state 0000000057ec838f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936731.441293:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784936731.441421:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+46:11448:x1871641503144576:12345-192.168.204.1@tcp:36:truncate.0 Request processed in 2104us (2574us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1784936731.441471:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 157 00000020:00080000:1.0:1784936731.441479:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784936731.445876:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.445894:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.445902:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.445909:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936731.445914:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.445922:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.445941:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936731.445944:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936731.446180:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.446189:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f63a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936731.598694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936731.599373:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503144704 00000100:00100000:3.0:1784936731.599392:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503144704 00000100:00100000:3.0:1784936731.599503:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 158 00000100:00100000:3.0:1784936731.599515:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+45:11462:x1871641503144704:12345-192.168.204.1@tcp:101:stat.0 00010000:00010000:3.0:1784936731.599565:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936731.599593:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f63a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f55 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600087:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600107:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600121:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600138:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600147:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600154:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600291:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600301:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600331:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936731.600390:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1784936731.600395:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936731.600458:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600473:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600482:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600488:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600496:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600502:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936731.600507:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600514:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600528:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936731.600542:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936731.600554:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600571:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f63b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600589:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600594:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600600:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600605:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936731.600607:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600613:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600620:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173aa00) 00010000:00010000:3.0:1784936731.600622:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936731.600625:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.600630:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f63b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.601323:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f63a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 47 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.601975:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 46 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.602008:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:3.0:1784936731.602012:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936731.602016:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4a00, rc 0) 00000100:00100000:3.0:1784936731.602117:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+46:11462:x1871641503144704:12345-192.168.204.1@tcp:101:stat.0 Request processed in 2602us (3445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936731.602128:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 158 00000001:00080000:0.0:1784936731.636467:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1784936731.636496:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1784936731.678272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.682958:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503144960 00000100:00100000:0.0:1784936731.683011:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503144960 00000100:00100000:0.0:1784936731.683096:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:0.0:1784936731.683108:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+46:11473:x1871641503144960:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936731.683138:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936731.683165:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f5c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936731.683319:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784936731.683517:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f5c expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.683535:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:0.0:1784936731.683538:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936731.683544:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f5c expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.683565:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a000, rc 0) 00000100:00100000:0.0:1784936731.683651:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+47:11473:x1871641503144960:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 545us (5398us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1784936731.683659:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:2.0:1784936731.693175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.697580:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503145216 00000100:00100000:0.0:1784936731.697603:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503145216 00000100:00100000:0.0:1784936731.697837:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:0.0:1784936731.697852:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8813050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+47:11473:x1871641503145216:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936731.699611:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8813050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+48:11473:x1871641503145216:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 1750us (6438us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1784936731.699624:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:2.0:1784936731.788711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.788868:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503145472 00000100:00100000:1.0:1784936731.788883:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503145472 00000100:00100000:1.0:1784936731.788972:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 160 00000100:00100000:1.0:1784936731.788984:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+48:11479:x1871641503145472:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936731.789020:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936731.789269:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f63d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f63 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.789470:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.789489:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 49 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.789500:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.789564:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 49 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.789786:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 49 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936731.789805:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524117376:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936731.789935:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936731.796864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.797105:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524117376:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936731.797153:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.800680:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503145600 00000100:00100000:2.0:1784936731.800705:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503145600 00010000:00010000:2.0:1784936731.800787:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 50 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.800847:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:2.0:1784936731.800859:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+50:2372:x1871641503145600:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936731.800881:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936731.800889:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 50 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.800907:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 50 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.800936:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f63be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f55 expref: 50 pid: 6621 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.800957:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:2.0:1784936731.800963:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.800973:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.801001:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.801049:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936731.801142:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+49:2372:x1871641503145600:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 285us (4304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936731.801151:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00010000:00010000:0.0:1784936731.803644:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.803669:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936731.803703:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1784936731.804205:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f63d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.804232:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.804243:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936731.804246:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784936731.804251:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:0.0:1784936731.804332:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+49:11479:x1871641503145472:12345-192.168.204.1@tcp:101:bash.0 Request processed in 15349us (15636us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1784936731.804342:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 160 00000100:00100000:2.0:1784936731.823220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.823422:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503145856 00000100:00100000:0.0:1784936731.823480:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503145856 00000100:00100000:0.0:1784936731.823552:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 161 00000100:00100000:0.0:1784936731.823564:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+49:11479:x1871641503145856:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:0.0:1784936731.824176:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.824202:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.824233:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936731.824302:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1784936731.824330:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc71cb3a reply state 000000005faa973a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936731.824341:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936731.824552:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+52:11479:x1871641503145856:12345-192.168.204.1@tcp:36:bash.0 Request processed in 987us (1343us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1784936731.824561:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 161 00000020:00080000:0.0:1784936731.824568:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784936731.829595:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.829623:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.829632:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.829639:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936731.829646:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.829654:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.829676:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936731.829703:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936731.829711:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.829718:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f63e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.844604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.844792:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503145984 00000100:00100000:0.0:1784936731.844806:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503145984 00000100:00100000:0.0:1784936731.844893:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 162 00000100:00100000:0.0:1784936731.844905:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+51:11479:x1871641503145984:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936731.844938:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936731.844965:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f63ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f6a expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.845079:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.845098:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.845107:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.846131:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936731.846161:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 52 pid: 5798 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936731.846180:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524117504:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936731.846311:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81e300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936731.856206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.856398:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524117504:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936731.856490:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.859806:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503146112 00000100:00100000:2.0:1784936731.859831:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503146112 00010000:00010000:2.0:1784936731.859930:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 53 pid: 5798 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936731.859997:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:2.0:1784936731.860009:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+53:2371:x1871641503146112:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936731.860034:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936731.860045:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 53 pid: 5798 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.860063:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 53 pid: 5798 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.860092:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f63da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f63 expref: 53 pid: 5798 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.860114:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:2.0:1784936731.860140:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.860152:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.860160:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936731.860199:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936731.860294:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+52:2371:x1871641503146112:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 286us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936731.860302:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00010000:00010000:3.0:1784936731.863137:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.863162:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936731.863242:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784936731.863247:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936731.863279:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.863331:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f63ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f6a expref: 52 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.863367:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f6a expref: 51 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936731.863380:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:3.0:1784936731.863383:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936731.863412:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b800, rc 0) 00000100:00100000:3.0:1784936731.863552:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+51:11479:x1871641503145984:12345-192.168.204.1@tcp:101:bash.0 Request processed in 18647us (18962us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936731.863562:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 162 00000100:00100000:3.0:1784936731.873544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.873701:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503146368 00000100:00100000:1.0:1784936731.873715:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503146368 00000100:00100000:1.0:1784936731.873803:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:1.0:1784936731.873817:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+51:11479:x1871641503146368:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:1.0:1784936731.874233:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+52:11479:x1871641503146368:12345-192.168.204.1@tcp:35:bash.0 Request processed in 419us (703us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1784936731.874243:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:2.0:1784936731.963622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.963880:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503146624 00000100:00100000:1.0:1784936731.963895:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503146624 00000100:00100000:1.0:1784936731.963987:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 163 00000100:00100000:1.0:1784936731.963999:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+52:11489:x1871641503146624:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936731.964036:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936731.964067:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f63fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f71 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936731.964258:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1784936731.964496:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f63fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f71 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.964528:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:1.0:1784936731.964533:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936731.964558:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f63fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f71 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.964575:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165000, rc 0) 00000100:00100000:1.0:1784936731.964668:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+53:11489:x1871641503146624:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 670us (1060us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1784936731.964676:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 163 00000100:00100000:2.0:1784936731.972465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936731.972567:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503146752 00000100:00100000:1.0:1784936731.972582:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503146752 00000100:00100000:1.0:1784936731.972672:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:1.0:1784936731.972686:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+53:11489:x1871641503146752:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:1.0:1784936731.972815:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.972837:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.972853:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.972871:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.972879:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.972886:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973023:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973051:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973060:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936731.973118:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973135:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973143:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973150:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973158:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936731.973163:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973172:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973187:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936731.973191:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936731.973197:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973205:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f640b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973555:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973562:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973568:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973574:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936731.973577:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973584:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973594:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096c7246300) 00010000:00010000:1.0:1784936731.973596:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936731.973600:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973606:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973624:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973631:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973637:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973940:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936731.973944:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973952:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973961:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936731.973964:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936731.973967:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936731.973974:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936731.974092:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+53:11489:x1871641503146752:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 1406us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936731.974102:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 164 00010000:00010000:0.0:1784936731.977968:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936731.988888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936731.989029:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503147008 00000100:00100000:0.0:1784936731.989044:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503147008 00000100:00100000:0.0:1784936731.989119:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:0.0:1784936731.989131:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+53:11489:x1871641503147008:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936731.989831:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+54:11489:x1871641503147008:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 699us (954us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1784936731.989841:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:0.0:1784936732.040962:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524118016:0@lo:400:kworker.0 00000100:00100000:3.0:1784936732.041033:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524117632:0@lo:400:kworker.0 00000100:00100000:3.0:1784936732.041131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936732.041205:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524117632 00000100:00100000:1.0:1784936732.041215:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524117632 00000100:00100000:1.0:1784936732.041271:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784936732.041280:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524117632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936732.041454:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524117760:0@lo:400:kworker.0 00000100:00100000:1.0:1784936732.045723:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524117632:12345-0@lo:400:kworker.0 Request processed in 4433us (4581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936732.045738:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784936732.045821:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524117888:0@lo:400:kworker.0 00000100:00100000:1.0:1784936732.045861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936732.045949:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524117888 00000100:00100000:1.0:1784936732.045957:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524117888 00000100:00100000:1.0:1784936732.046023:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784936732.046033:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524117888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936732.046091:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524117888:12345-0@lo:400:kworker.0 Request processed in 60us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936732.046098:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784936732.046141:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524117888:0@lo:400:kworker.0 00000100:00100000:0.0:1784936732.047390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936732.047598:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524118016 00000100:00100000:1.0:1784936732.047605:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524118016 00000100:00100000:1.0:1784936732.047653:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784936732.047661:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524118016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936732.047704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936732.047729:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524118016:12345-0@lo:400:kworker.0 Request processed in 66us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936732.047737:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784936732.047790:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524118272:0@lo:400:kworker.0 00000100:00100000:0.0:1784936732.047847:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524118016:0@lo:400:kworker.0 00000100:00100000:2.0:1784936732.047862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784936732.047910:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936732.047918:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936732.047974:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524117760 00000100:00100000:2.0:1784936732.047983:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524117760 00000100:00100000:2.0:1784936732.048031:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784936732.048040:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524117760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936732.048185:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524118272 00000100:00100000:1.0:1784936732.048192:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524118272 00000100:00100000:1.0:1784936732.048229:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784936732.048236:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524118272:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1784936732.048317:0:7795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397799887581ns, next at 398799885198ns, rc = 0 00000100:00080000:0.0:1784936732.048363:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936732.048378:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524118400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936732.048417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936732.048576:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524118400 00000100:00100000:0.0:1784936732.048580:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524118400 00000100:00100000:0.0:1784936732.048609:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784936732.048615:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524118400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784936732.048631:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1784936732.048664:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524118400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936732.048671:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784936732.048867:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1784936732.048873:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1784936732.048895:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524118400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936732.050573:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524117760:12345-0@lo:400:kworker.0 Request processed in 2520us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936732.050593:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784936732.050645:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524117760:0@lo:400:kworker.0 00000100:00100000:1.0:1784936732.051684:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524118272:12345-0@lo:400:kworker.0 Request processed in 3444us (3826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936732.051697:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784936732.051877:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524118272:0@lo:400:kworker.0 00000100:00100000:3.0:1784936732.053978:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524117632:0@lo:400:kworker.0 00000100:00100000:3.0:1784936732.054007:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524118144:0@lo:400:kworker.0 00000100:00100000:2.0:1784936732.054034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936732.054379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936732.058609:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503147264 00000100:00100000:1.0:1784936732.058627:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503147264 00000100:00100000:0.0:1784936732.058810:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524118144 00000100:00100000:0.0:1784936732.058815:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524118144 00000100:00080000:2.0:1784936732.061240:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936732.061456:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 165 00000100:00100000:1.0:1784936732.061502:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+54:11492:x1871641503147264:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936732.061536:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936732.061583:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f78 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061678:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061695:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061709:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061725:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061734:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061741:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061888:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061899:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.061906:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936732.061917:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784936732.062036:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.062054:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.062061:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063282:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936732.063294:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063307:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063325:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936732.063328:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936732.063333:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063339:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063367:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063374:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063381:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063387:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936732.063402:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063409:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063417:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096c7246300) 00010000:00010000:1.0:1784936732.063420:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936732.063423:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063469:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f642e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063549:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f78 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063566:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f78 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.063573:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936732.063576:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936732.063578:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165e00, rc 0) 00000100:00100000:1.0:1784936732.063658:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+56:11492:x1871641503147264:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 2188us (9633us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1784936732.063668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 165 00000100:00100000:2.0:1784936732.066645:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784936732.066677:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524118144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936732.066774:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524118144:12345-0@lo:400:kworker.0 Request processed in 115us (12397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936732.066782:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784936732.066926:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524118144:0@lo:400:kworker.0 00000100:00100000:2.0:1784936732.076101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936732.076202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936732.078132:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503147392 00000100:00100000:0.0:1784936732.078148:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503147392 00000100:00100000:0.0:1784936732.078235:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 166 00000100:00100000:0.0:1784936732.078246:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+56:11492:x1871641503147392:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1784936732.078321:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.078366:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.078379:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.078409:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.078417:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.078423:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.078478:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ba00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936732.079066:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.079077:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.079092:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936732.079096:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936732.079100:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.079107:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936732.079209:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+56:11492:x1871641503147392:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 962us (3004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936732.079230:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 166 00000100:00100000:1.0:1784936732.083722:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503147520 00000100:00100000:1.0:1784936732.083738:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503147520 00000100:00100000:2.0:1784936732.085298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936732.085343:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1784936732.085369:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+56:2372:x1871641503147520:12345-192.168.204.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784936732.085380:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503147776 00000100:00100000:0.0:1784936732.085389:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503147776 00010000:00010000:1.0:1784936732.085407:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936732.085456:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f78 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936732.085458:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:0.0:1784936732.085471:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+57:11492:x1871641503147776:12345-192.168.204.1@tcp:35:lfs.0 00010000:00010000:1.0:1784936732.085483:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936732.085490:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936732.085710:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+57:11492:x1871641503147776:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 237us (418us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1784936732.085717:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:1.0:1784936732.086327:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+56:2372:x1871641503147520:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 971us (10232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936732.086335:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:2.0:1784936732.262532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936732.265033:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503148032 00000100:00100000:0.0:1784936732.265051:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503148032 00000100:00100000:0.0:1784936732.265405:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:0.0:1784936732.265417:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+56:11510:x1871641503148032:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:0.0:1784936732.265468:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936732.265498:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f644a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f7f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.265605:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6451 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.265620:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.265634:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6451 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936732.265645:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784936732.265780:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f644a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f7f expref: 59 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.265819:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6451 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f7f expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.265828:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936732.265831:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784936732.265835:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26aa00, rc 0) 00000100:00100000:0.0:1784936732.265959:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+58:11510:x1871641503148032:12345-192.168.204.1@tcp:101:cat.0 Request processed in 544us (3437us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1784936732.265967:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 167 00000100:00100000:2.0:1784936732.318770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936732.320712:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503148160 00000100:00100000:1.0:1784936732.320739:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503148160 00000100:00100000:1.0:1784936732.320821:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:1.0:1784936732.320831:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+58:11511:x1871641503148160:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936732.320861:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936732.320884:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f645f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f86 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.321363:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.321379:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.321392:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936732.321496:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1784936732.321501:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936732.321539:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.321569:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f645f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f86 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.321592:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f86 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936732.321601:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936732.321605:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936732.321609:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164600, rc 0) 00000100:00100000:1.0:1784936732.321693:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+59:11511:x1871641503148160:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 863us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936732.321700:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:3.0:1784936732.337575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936732.337798:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503148544 00000100:00100000:0.0:1784936732.337810:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503148544 00000100:00100000:0.0:1784936732.337874:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:0.0:1784936732.337884:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+59:11511:x1871641503148544:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936732.338249:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+60:11511:x1871641503148544:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 366us (684us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784936732.338258:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1784936732.341116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936732.341592:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503148672 00000100:00100000:0.0:1784936732.341602:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503148672 00000100:00100000:0.0:1784936732.341689:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1784936732.341700:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+60:11511:x1871641503148672:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:0.0:1784936732.341717:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784936732.341891:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f63f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f6a expref: 60 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.341914:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f7f expref: 59 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.341942:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f6301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f2b expref: 58 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.341953:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246600) 00010000:00010000:0.0:1784936732.341963:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936732.342023:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+57:11511:x1871641503148672:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 324us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936732.342031:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:3.0:1784936732.345526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936732.345923:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503148800 00000100:00100000:2.0:1784936732.345934:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503148800 00000100:00100000:2.0:1784936732.345999:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:2.0:1784936732.346011:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+57:11511:x1871641503148800:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:2.0:1784936732.346121:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936732.346218:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936732.346230:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936732.347627:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1784936732.348069:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+57:11511:x1871641503148800:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 2056us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936732.348079:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:3.0:1784936732.404772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936732.404980:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503148928 00000100:00100000:0.0:1784936732.404990:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503148928 00000100:00100000:0.0:1784936732.405056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:0.0:1784936732.405066:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+57:11513:x1871641503148928:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936732.405089:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936732.405112:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f8d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405182:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405197:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405210:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405224:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405254:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405263:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405377:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405385:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405392:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936732.405472:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784936732.405486:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936732.405507:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405520:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405529:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405536:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405543:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405559:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936732.405563:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405571:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405583:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:0.0:1784936732.405586:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936732.405591:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405597:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f647b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405609:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405615:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405620:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405624:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ba00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936732.405627:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405633:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405651:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096caf90100) 00010000:00010000:0.0:1784936732.405653:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936732.405656:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405661:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405690:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405701:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936732.405708:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936732.405710:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784936732.405712:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b400, rc 0) 00000100:00100000:0.0:1784936732.405781:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+58:11513:x1871641503148928:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 716us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936732.405789:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 170 00000100:00100000:3.0:1784936732.596826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936732.596860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936732.596885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936732.596913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936732.596942:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149312 00000100:00100000:3.0:1784936732.596951:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149312 00000100:00100000:3.0:1784936732.597008:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149184 00000100:00100000:3.0:1784936732.597012:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149184 00000100:00100000:3.0:1784936732.597036:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:3.0:1784936732.597045:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503149312:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936732.597115:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503149312:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936732.597141:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:3.0:1784936732.597162:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:3.0:1784936732.597169:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503149184:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936732.597197:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503149184:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 28us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936732.597202:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00080000:3.0:1784936732.597219:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936732.597222:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936732.597321:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149440 00000100:00100000:3.0:1784936732.597326:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149440 00000100:00100000:3.0:1784936732.597376:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 154 00000100:00100000:3.0:1784936732.597383:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503149440:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936732.597416:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2373:x1871641503149440:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936732.597422:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 154 00000100:00080000:3.0:1784936732.597466:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936732.600650:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149056 00000100:00100000:0.0:1784936732.600665:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149056 00000100:00100000:0.0:1784936732.600732:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 296 00000100:00100000:0.0:1784936732.600743:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503149056:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936732.600816:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503149056:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 75us (4001us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936732.600824:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 296 00010000:00010000:3.0:1784936733.000903:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784936733.193509:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936733.193519:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936733.193568:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1784936733.193577:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784936733.193783:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec822d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524118528:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784936733.193888:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e5cb2180 going to sleep for 11 seconds 00000100:00100000:3.0:1784936733.206090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.206130:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149568 00000100:00100000:3.0:1784936733.206148:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149568 00000100:00100000:3.0:1784936733.206204:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00100000:3.0:1784936733.206212:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503149568:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784936733.206246:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784936733.206362:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503149568:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 149us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.206370:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 171 00000100:00100000:2.0:1784936733.206827:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec822d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524118528:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784936733.220138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.220238:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149696 00000100:00100000:3.0:1784936733.220249:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149696 00000100:00100000:3.0:1784936733.220319:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 172 00000100:00100000:3.0:1784936733.220343:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+58:11524:x1871641503149696:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784936733.220447:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220465:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220478:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220496:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220505:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220512:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220539:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220562:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220569:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936733.220610:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784936733.220614:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936733.220629:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220641:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220648:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220656:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220664:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.220668:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220676:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220689:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:3.0:1784936733.220693:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936733.220697:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220725:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f6490 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220740:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220746:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220752:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220757:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.220759:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220765:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220772:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9096d173aa00) 00010000:00010000:3.0:1784936733.220774:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936733.220777:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220782:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6497 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220809:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220814:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220825:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220830:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.220833:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220838:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220844:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:3.0:1784936733.220846:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936733.220849:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.220854:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f649e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.220916:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+58:11524:x1871641503149696:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 587us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.220924:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 172 00000100:00100000:3.0:1784936733.222923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.222954:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503149952 00000100:00100000:3.0:1784936733.222963:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503149952 00000100:00100000:3.0:1784936733.223018:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:3.0:1784936733.223026:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+58:11524:x1871641503149952:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784936733.223053:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936733.223071:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f94 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223180:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223193:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223203:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936733.223213:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784936733.223302:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223309:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223316:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223322:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.223326:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223349:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223362:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:3.0:1784936733.223365:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936733.223370:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223387:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f64ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223449:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f94 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223460:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:3.0:1784936733.223462:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784936733.223466:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f94 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.223475:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4200, rc 0) 00000100:00100000:3.0:1784936733.223526:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503149952:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 501us (611us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1784936733.223532:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 173 00000040:00080000:1.0:1784936733.225146:0:12325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936733.225156:0:12325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936733.225198:0:12325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784936733.225203:0:12325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784936733.227484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.227522:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503150080 00000100:00100000:3.0:1784936733.227531:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503150080 00000100:00100000:3.0:1784936733.227585:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 174 00000100:00100000:3.0:1784936733.227595:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503150080:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784936733.227646:0:6621:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784936733.227928:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503150080:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 333us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.227937:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 174 00000100:00100000:3.0:1784936733.232035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936733.234735:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503150336 00000100:00100000:1.0:1784936733.234751:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503150336 00000100:00100000:1.0:1784936733.234828:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 175 00000100:00100000:1.0:1784936733.234840:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503150336:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936733.234865:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936733.234868:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784936733.234897:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f86 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.234916:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936733.234937:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936733.234969:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94f9b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784936733.235400:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1784936733.235627:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f64c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.235641:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f64c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.235653:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f64c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.235714:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f9b expref: 61 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.235730:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f64c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f9b expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.235738:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246300) 00010000:00010000:1.0:1784936733.235740:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936733.235743:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164000, rc 0) 00000100:00100000:1.0:1784936733.235814:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+60:11524:x1871641503150336:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 975us (3788us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1784936733.235822:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 175 00000100:00100000:1.0:1784936733.241742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.241820:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503150592 00000100:00100000:3.0:1784936733.241836:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503150592 00000100:00100000:3.0:1784936733.241903:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 176 00000100:00100000:3.0:1784936733.241914:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+60:11524:x1871641503150592:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784936733.241994:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936733.242031:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f64c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f9b expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242053:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246300) 00010000:00010000:3.0:1784936733.242066:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936733.242092:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242108:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242120:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242135:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242142:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242149:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242243:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242252:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242266:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242273:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.242277:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242286:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242295:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936733.242298:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936733.242302:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242308:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f64cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242319:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242326:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242347:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242352:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.242355:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242371:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242379:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x29bb428a (ffff9096d173aa00) 00010000:00010000:3.0:1784936733.242381:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936733.242384:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.242389:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f64d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x29bb428a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.242534:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503150592:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 620us (800us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784936733.242542:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 176 00000100:00100000:3.0:1784936733.244931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936733.245324:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503150720 00000100:00100000:1.0:1784936733.245421:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503150720 00000100:00100000:1.0:1784936733.245523:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:1.0:1784936733.245534:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+59:11524:x1871641503150720:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936733.245558:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936733.245586:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f64dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fa2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.245629:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.245644:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.245656:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.245835:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f64dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.245854:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.245863:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:1.0:1784936733.245866:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784936733.245871:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165000, rc 0) 00000100:00100000:1.0:1784936733.245941:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+60:11524:x1871641503150720:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 409us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936733.245949:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 177 00000100:00100000:2.0:1784936733.251266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936733.251318:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503150976 00000100:00100000:1.0:1784936733.251328:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503150976 00000100:00100000:1.0:1784936733.251414:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 178 00000100:00100000:1.0:1784936733.251440:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+60:11524:x1871641503150976:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784936733.251526:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.251542:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.251554:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784936733.251874:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1784936733.251883:0:6621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399003454597ns, next at 400003452529ns, rc = 0 00000004:00010000:1.0:1784936733.251989:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085b1bbda reply state 00000000e88ab251 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936733.252000:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784936733.252111:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+62:11524:x1871641503150976:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 687us (855us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1784936733.252119:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 178 00010000:00010000:3.0:1784936733.257254:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.257268:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.257276:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.257282:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.257287:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.257294:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.257321:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:3.0:1784936733.257324:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784936733.257339:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.257346:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f64eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936733.258600:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936733.258661:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503151104 00000100:00100000:1.0:1784936733.258672:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503151104 00000100:00100000:1.0:1784936733.258734:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 179 00000100:00100000:1.0:1784936733.258748:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+61:11524:x1871641503151104:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936733.258777:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936733.258799:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fa9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.258867:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.258891:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.258920:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:1.0:1784936733.258924:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936733.258926:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165c00, rc 0) 00000100:00100000:1.0:1784936733.259043:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+62:11524:x1871641503151104:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 298us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936733.259050:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 179 00000100:00100000:3.0:1784936733.268264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.268304:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503151232 00000100:00100000:3.0:1784936733.268314:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503151232 00000100:00100000:3.0:1784936733.268381:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1784936733.268403:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503151232:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784936733.269053:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503151232:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 662us (797us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1784936733.269062:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1784936733.276278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.276347:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503151488 00000100:00100000:3.0:1784936733.276356:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503151488 00000100:00100000:3.0:1784936733.276790:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:3.0:1784936733.276802:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+62:11524:x1871641503151488:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784936733.277045:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+63:11524:x1871641503151488:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 245us (777us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1784936733.277052:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:0.0:1784936733.281918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.282014:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503151744 00000100:00100000:2.0:1784936733.282024:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503151744 00000100:00100000:2.0:1784936733.282088:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 180 00000100:00100000:2.0:1784936733.282099:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+63:11524:x1871641503151744:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784936733.282223:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+63:11524:x1871641503151744:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 125us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.282231:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 180 00000100:00100000:3.0:1784936733.286543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.286645:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503151872 00000100:00100000:2.0:1784936733.286656:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503151872 00000100:00100000:2.0:1784936733.286717:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 181 00000100:00100000:2.0:1784936733.286728:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+63:11524:x1871641503151872:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936733.286749:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936733.286771:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f64f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fb0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.286844:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.286859:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.286871:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936733.286909:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936733.286952:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.286979:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f64f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb0 expref: 65 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.286995:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb0 expref: 64 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.287005:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:2.0:1784936733.287008:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784936733.287012:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19200, rc 0) 00000100:00100000:2.0:1784936733.287072:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+64:11524:x1871641503151872:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 346us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.287080:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 181 00000100:00100000:0.0:1784936733.301865:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.301954:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152000 00000100:00100000:3.0:1784936733.301989:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152000 00000100:00100000:3.0:1784936733.302093:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1784936733.302105:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503152000:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784936733.302129:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936733.302154:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fb7 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936733.302187:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f91d, blocks: 0x1 00010000:00010000:3.0:1784936733.302211:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1784936733.302217:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936733.302227:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.302248:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.302263:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4200, rc 0) 00000100:00100000:3.0:1784936733.302327:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503152000:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 224us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.302346:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1784936733.307300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.307394:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152256 00000100:00100000:3.0:1784936733.307404:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152256 00000100:00100000:3.0:1784936733.307553:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 182 00000100:00100000:3.0:1784936733.307563:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+64:11524:x1871641503152256:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784936733.307674:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+64:11524:x1871641503152256:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.307698:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 182 00000100:00100000:3.0:1784936733.310404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.311214:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152384 00000100:00100000:2.0:1784936733.311226:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152384 00000100:00100000:2.0:1784936733.311280:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:2.0:1784936733.311289:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+8:11524:x1871641503152384:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936733.311319:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936733.311349:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fbe expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.311381:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.311390:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936733.311395:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936733.311408:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 9 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.311464:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.311481:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936733.311498:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524118656:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936733.311587:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d46086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936733.316536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.316645:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524118656:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936733.316687:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 9 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.316720:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19800, rc 0) 00000100:00100000:3.0:1784936733.316781:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+9:11524:x1871641503152384:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 5492us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.316790:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:1.0:1784936733.317691:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152512 00000100:00100000:1.0:1784936733.317701:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152512 00010000:00010000:1.0:1784936733.317735:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936733.317773:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:1.0:1784936733.317783:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503152512:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936733.317798:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936733.317821:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.317837:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.317859:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6507 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb7 expref: 9 pid: 6598 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.317887:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936733.317892:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936733.317901:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.317911:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.317947:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936733.317962:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c593dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1871641524118784:192.168.204.1@tcp:105: 00000100:00100000:1.0:1784936733.318028:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0000 going to sleep for 11 seconds 00000100:00100000:3.0:1784936733.326099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936733.326410:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c593dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1871641524118784:192.168.204.1@tcp:105: 00010000:00010000:1.0:1784936733.326453:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936733.326514:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503152512:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 8732us (9986us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936733.326525:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:0.0:1784936733.326948:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152640 00000100:00100000:0.0:1784936733.326957:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152640 00002000:00100000:0.0:1784936733.327072:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9096ec822d80 x1871641503152640/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:474/0 lens 504/0 e 0 to 0 dl 1784936744 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936733.327084:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ec822d80 with x1871641503152640 ext(0->8) 00002000:00010000:0.0:1784936733.327089:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096ec822d80 00000100:00100000:0.0:1784936733.327272:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1784936733.327282:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503152640:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784936733.329148:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+10:2372:x1871641503152640:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 1856us (3047us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784936733.329162:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00002000:00100000:0.0:1784936733.329177:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9096ec822d80 x1871641503152640/t4294967314(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:474/0 lens 504/448 e 0 to 0 dl 1784936744 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936733.329187:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ec822d80 with x1871641503152640 ext(0->8) 00002000:00010000:0.0:1784936733.329192:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096ec822d80 00000100:00100000:0.0:1784936733.341243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.341402:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152768 00000100:00100000:2.0:1784936733.341413:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152768 00000100:00100000:2.0:1784936733.341505:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 183 00000100:00100000:2.0:1784936733.341517:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+64:11524:x1871641503152768:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784936733.460746:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1784936733.460773:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1784936733.460820:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1784936733.460823:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:2.0:1784936733.460862:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+31:11524:x1871641503152768:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 119342us (119623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.460872:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 183 00000004:00080000:0.0:1784936733.460874:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1784936733.460885:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096c11ca780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1784936733.460897:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096d4714b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096c11cae40 00000020:00080000:0.0:1784936733.460900:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096d4714400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096ff3e7000 00000001:00080000:0.0:1784936733.460923:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:1.0:1784936733.463841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000020:00080000:3.0:1784936733.463900:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1784936733.464143:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1784936733.465446:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503152896 00000100:00100000:2.0:1784936733.465455:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503152896 00000100:00100000:2.0:1784936733.465510:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1784936733.465520:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+10:2372:x1871641503152896:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784936733.465834:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936733.465852:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524118912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784936733.465924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936733.465985:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524118912 00000100:00100000:3.0:1784936733.465989:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524118912 00000100:00100000:3.0:1784936733.466016:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784936733.466022:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524118912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784936733.466180:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784936733.466183:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784936733 00002000:00010000:3.0:1784936733.466186:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784936733.466188:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784936733 -> 1784936733 00002000:00010000:3.0:1784936733.466190:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784936733.466238:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1871641524118912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (313us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784936733.466245:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1784936733.466305:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096ede64e00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1784936733.466311:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524118912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784936733.467918:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936733.467938:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524119040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784936733.468001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936733.468095:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524119040 00000100:00100000:1.0:1784936733.468102:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524119040 00000100:00100000:1.0:1784936733.468151:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784936733.468159:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524119040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784936733.468187:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1784936733.468223:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a63f91a, atime: 0x6a63f91a, ctime: 0x6a63f91a, blocks: 0xb 00010000:00010000:1.0:1784936733.468233:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.468252:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1784936733.468257:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936733.468264:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.468280:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.468290:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.468297:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.468316:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784936733.468918:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1871641524119040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 758us (914us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784936733.468927:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1784936733.469216:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9095c1eaca80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1784936733.469223:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524119040:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784936733.469678:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936733.469688:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.469710:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936733.469715:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.469724:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.469746:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.469754:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000137ce17e/0x6cf7a864723f6515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.469771:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936733.469773:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936733.469775:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784936733.529379:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1784936733.529400:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1784936733.529598:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c593dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503152896:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 64072us (65763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936733.529610:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:2.0:1784936733.531928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.532903:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503153152 00000100:00100000:3.0:1784936733.532916:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503153152 00000100:00100000:3.0:1784936733.532987:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 184 00000100:00100000:3.0:1784936733.532997:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+19:11524:x1871641503153152:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784936733.533052:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936733.533079:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fb0 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.533097:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:3.0:1784936733.533102:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936733.533130:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.533144:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.533154:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936733.533402:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c5c0dad reply state 0000000097baaf3f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.533411:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936733.534154:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+20:11524:x1871641503153152:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1154us (2232us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1784936733.534164:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 184 00000100:00100000:2.0:1784936733.537722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.537794:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503153280 00000100:00100000:3.0:1784936733.537818:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503153280 00000100:00100000:3.0:1784936733.537877:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:3.0:1784936733.537887:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503153280:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1784936733.537921:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.537932:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.537939:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.537944:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936733.537949:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.537957:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.537973:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:1.0:1784936733.537976:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936733.537981:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.537987:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f651c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936733.538137:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784936733.538141:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784936733 -> 1784936731 00002000:00010000:3.0:1784936733.538144:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784936730 00002000:00010000:3.0:1784936733.538146:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784936733 -> 1784936731 00002000:00010000:3.0:1784936733.538149:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784936733.538209:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503153280:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 322us (495us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1784936733.538217:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:3.0:1784936733.547488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936733.547589:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503153536 00000100:00100000:1.0:1784936733.547600:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503153536 00000100:00100000:1.0:1784936733.547699:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 185 00000100:00100000:1.0:1784936733.547709:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+19:11524:x1871641503153536:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784936733.547780:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.547818:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.547828:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.547864:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936733.547881:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 19 pid: 5796 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936733.547897:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7c69180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524119168:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936733.547996:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936733.554890:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7c69180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1871641524119168:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936733.554928:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.557868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.558195:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503153664 00000100:00100000:2.0:1784936733.558207:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503153664 00010000:00010000:2.0:1784936733.558369:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 20 pid: 5796 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936733.558420:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:2.0:1784936733.559187:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+20:2371:x1871641503153664:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936733.559208:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936733.559218:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 20 pid: 5796 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.559296:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 20 pid: 5796 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.559320:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f64e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa2 expref: 20 pid: 5796 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.559348:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:2.0:1784936733.559353:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.559363:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.559372:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.559408:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936733.559608:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec84b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+19:2371:x1871641503153664:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1178us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.559617:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00010000:00010000:3.0:1784936733.559802:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559813:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559849:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559857:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559879:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559891:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.559896:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559905:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559917:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:3.0:1784936733.559920:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784936733.559924:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.559931:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f6523 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.559979:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+18:11524:x1871641503153536:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 12271us (12500us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784936733.559988:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 185 00000100:00100000:1.0:1784936733.565725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.565902:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503153792 00000100:00100000:3.0:1784936733.565913:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503153792 00000100:00100000:3.0:1784936733.565977:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:3.0:1784936733.565987:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503153792:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784936733.566033:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.566052:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.566072:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936733.566076:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936733.566081:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.566116:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.566133:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 8 pid: 6597 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.566147:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6595:1871641524119296:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936733.566231:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936733.569492:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6595:1871641524119296:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936733.569523:0:6595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936733.569696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.569965:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503153920 00000100:00100000:2.0:1784936733.569986:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503153920 00010000:00010000:2.0:1784936733.570026:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 9 pid: 6597 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936733.570060:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:2.0:1784936733.570069:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d464bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503153920:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936733.570085:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936733.570107:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 9 pid: 6597 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.570123:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 9 pid: 6597 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.570144:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f650e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fbe expref: 9 pid: 6597 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.571410:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936733.571415:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936733.571421:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.571539:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.571579:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936733.571651:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d464bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503153920:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1578us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.571675:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 70 00010000:00010000:3.0:1784936733.574398:0:6595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574416:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574490:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574513:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574521:0:6595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574528:0:6595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936733.574532:0:6595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574540:0:6595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574559:0:6595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.574565:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d2d1d9/0x6cf7a864723f652a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.574664:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503153792:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 8674us (8949us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936733.574674:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:1.0:1784936733.577704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936733.577789:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503154176 00000100:00100000:0.0:1784936733.577799:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503154176 00000100:00100000:0.0:1784936733.577855:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 186 00000100:00100000:0.0:1784936733.577866:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+18:11524:x1871641503154176:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784936733.577944:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.577962:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.577974:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.578181:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.578193:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.578201:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.578236:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.578269:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 19 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936733.578283:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524119424:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936733.578372:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936733.580308:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524119424:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936733.580344:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936733.581247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936733.581337:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503154304 00000100:00100000:2.0:1784936733.581345:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503154304 00010000:00010000:2.0:1784936733.581378:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 20 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936733.581418:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:2.0:1784936733.581455:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+20:2371:x1871641503154304:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936733.581470:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936733.581477:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 20 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.581491:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 20 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.581514:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f64f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fa9 expref: 20 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.581528:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:2.0:1784936733.581533:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.581542:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.581548:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.581581:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936733.581636:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+19:2371:x1871641503154304:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 209us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.581644:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 71 00010000:00010000:0.0:1784936733.581837:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.581846:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936733.582039:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1784936733.582198:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1784936733.582243:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1784936733.582333:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524119552:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784936733.582381:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936733.582701:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936733.583290:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524119552 00000100:00100000:2.0:1784936733.583298:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524119552 00000100:00100000:2.0:1784936733.583389:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784936733.583400:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6621:x1871641524119552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784936733.583520:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6621:x1871641524119552:12345-0@lo:1000:mdt00_003.0 Request processed in 123us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.583527:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784936733.583602:0:6621:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1784936733.583608:0:6621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096ede64e00, transno 4294967315 00000100:00100000:0.0:1784936733.583624:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524119552:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1784936733.584062:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1784936733.584123:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524119680:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784936733.584167:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936733.588062:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936733.591554:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524119680 00000100:00100000:1.0:1784936733.591571:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524119680 00000100:00100000:1.0:1784936733.591630:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784936733.591639:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6621:x1871641524119680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784936733.594120:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524119680:12345-0@lo:1000:mdt00_003.0 Request processed in 2473us (9944us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784936733.594133:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936733.594247:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c1ead500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524119680:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784936733.594290:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594301:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594309:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594316:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936733.594321:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594341:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594358:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:0.0:1784936733.594361:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936733.594366:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594373:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6538 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594405:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594412:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594451:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594456:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936733.594459:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594465:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594474:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:0.0:1784936733.594477:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936733.594479:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594486:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f646d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594509:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594523:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594532:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594567:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936733.594584:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 22 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936733.594607:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524119808:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936733.594688:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ec81ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936733.597886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936733.597968:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524119808:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936733.597997:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936733.598072:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503154432 00000100:00100000:2.0:1784936733.598080:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503154432 00010000:00010000:2.0:1784936733.598113:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 23 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936733.598184:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:2.0:1784936733.598193:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+23:2372:x1871641503154432:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936733.598211:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936733.598220:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 23 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.598236:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 23 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.598256:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94f8d expref: 23 pid: 5798 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.598283:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:2.0:1784936733.598288:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.598298:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.598306:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936733.598339:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936733.598385:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+22:2372:x1871641503154432:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 192us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936733.598392:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00010000:00010000:3.0:1784936733.598491:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598508:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598520:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598526:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598533:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598540:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.598544:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598551:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598561:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:3.0:1784936733.598564:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936733.598568:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598574:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f653f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598585:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598592:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598604:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598609:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936733.598612:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598618:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598626:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d7e59f00) 00010000:00010000:3.0:1784936733.598629:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784936733.598632:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.598637:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f6531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936733.598837:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+21:11524:x1871641503154176:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 20973us (21141us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1784936733.598847:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 186 00000020:00080000:3.0:1784936733.598851:0:6621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1784936733.601697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936733.601790:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503154688 00000100:00100000:3.0:1784936733.601800:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503154688 00000100:00100000:3.0:1784936733.601860:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1784936733.601869:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8812850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+21:11524:x1871641503154688:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784936733.602610:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784936733.602722:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1784936733.602777:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.602794:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.602804:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.602813:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.602818:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.602823:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.602842:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784936733.602931:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8812850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+23:11524:x1871641503154688:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1061us (1241us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1784936733.602939:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000020:00080000:3.0:1784936733.602944:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784936733.603001:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936733.603008:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.603015:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936733.603020:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.603030:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.603050:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9096d173aa00) 00010000:00010000:3.0:1784936733.603053:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784936733.603057:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.603063:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936733.603086:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936733.603088:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936733.603090:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784936733.603578:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936733.603583:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936733.604146:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1784936733.604155:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784936734.024636:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936735.056203:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784936735.206811:0:12377:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936735.206821:0:12377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784936735.206860:0:12377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784936735.206868:0:12377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784936735.371858:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.372395:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503154944 00000100:00100000:2.0:1784936735.372406:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503154944 00000100:00100000:2.0:1784936735.372507:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 187 00000100:00100000:2.0:1784936735.372519:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+23:11542:x1871641503154944:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936735.372549:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936735.372572:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f654d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fc5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.372875:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f6554 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.372897:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f6554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.372912:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f6554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936735.372925:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1784936735.373388:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f654d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fc5 expref: 26 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.373408:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f6554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fc5 expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.373417:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936735.373420:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784936735.373423:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18e00, rc 0) 00000100:00080000:3.0:1784936735.373568:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936735.373726:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+25:11542:x1871641503154944:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1208us (1877us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1784936735.373734:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 187 00000100:00100000:2.0:1784936735.388343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936735.395791:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503155072 00000100:00100000:1.0:1784936735.395809:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503155072 00000100:00100000:1.0:1784936735.395874:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 188 00000100:00100000:1.0:1784936735.395883:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+25:11542:x1871641503155072:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:1.0:1784936735.395963:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.395980:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.395994:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396020:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396027:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396033:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396341:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396349:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396356:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936735.396407:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396421:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396454:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396462:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396468:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936735.396473:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396480:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396493:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936735.396496:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936735.396501:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396506:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396517:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396523:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396535:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396540:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936735.396544:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396551:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396560:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096c7246c00) 00010000:00010000:1.0:1784936735.396563:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936735.396566:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396572:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396586:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396593:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396599:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396605:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936735.396608:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396626:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396634:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936735.396636:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936735.396639:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.396645:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936735.396740:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+25:11542:x1871641503155072:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 857us (8406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936735.396748:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 188 00000100:00100000:1.0:1784936735.469681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.470764:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503155328 00000100:00100000:3.0:1784936735.470777:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503155328 00000100:00100000:3.0:1784936735.470848:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 189 00000100:00100000:3.0:1784936735.470858:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+25:11545:x1871641503155328:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936735.470880:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936735.470907:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6577 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fcc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.471124:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.471140:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.471173:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.471188:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.471194:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.471200:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.472376:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.472390:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.472400:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936735.472411:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784936735.477361:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477383:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477392:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477418:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.477423:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477460:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477486:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936735.477490:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936735.477496:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477502:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f657e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477521:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477527:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477533:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477538:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.477541:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477547:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477567:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173aa00) 00010000:00010000:2.0:1784936735.477569:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936735.477573:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477578:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477645:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477661:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.477669:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936735.477671:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936735.477674:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4c00, rc 0) 00000100:00100000:2.0:1784936735.477781:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+27:11545:x1871641503155328:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 6923us (8109us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1784936735.477791:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 189 00000100:00100000:1.0:1784936735.487609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.488520:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503155456 00000100:00100000:2.0:1784936735.488535:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503155456 00000100:00100000:2.0:1784936735.488606:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 190 00000100:00100000:2.0:1784936735.488617:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:11545:x1871641503155456:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1784936735.488687:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488703:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488730:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488760:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488768:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488775:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488781:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.488785:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488793:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488805:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936735.488807:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936735.488813:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.488818:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f659a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936735.488911:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:11545:x1871641503155456:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 296us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936735.488919:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 190 00000100:00100000:1.0:1784936735.497354:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.497773:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503155712 00000100:00100000:3.0:1784936735.497782:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503155712 00000100:00100000:3.0:1784936735.497842:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:3.0:1784936735.497853:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+27:11545:x1871641503155712:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936735.498125:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+28:11545:x1871641503155712:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 273us (778us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1784936735.498134:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:1.0:1784936735.534648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.535114:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503155968 00000100:00100000:2.0:1784936735.535135:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503155968 00000100:00100000:2.0:1784936735.535334:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:2.0:1784936735.535346:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+28:11071:x1871641503155968:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936735.535374:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936735.535397:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f65a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fd3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.535549:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.535565:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.535584:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.535620:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.535636:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 29 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936735.535650:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524119936:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936735.536091:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784936735.539413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.539551:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524119936:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936735.539582:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936735.540388:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503156096 00000100:00100000:3.0:1784936735.540399:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503156096 00010000:00010000:3.0:1784936735.540486:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 30 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936735.540524:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:3.0:1784936735.540534:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+30:2371:x1871641503156096:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936735.540551:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936735.540559:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 30 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.540646:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 30 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.540871:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f658c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fcc expref: 30 pid: 5798 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.540889:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936735.540894:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.540905:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.540912:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.541005:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936735.541070:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+29:2371:x1871641503156096:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 538us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936735.541093:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00010000:00010000:2.0:1784936735.543010:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.543039:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936735.543061:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784936735.543221:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f65a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.543330:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.543338:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936735.543341:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784936735.543344:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19000, rc 0) 00000100:00100000:2.0:1784936735.543534:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+29:11071:x1871641503155968:12345-192.168.204.1@tcp:101:bash.0 Request processed in 8189us (8895us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1784936735.543542:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 191 00000100:00100000:1.0:1784936735.549903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.550015:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503156352 00000100:00100000:2.0:1784936735.550025:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503156352 00000100:00100000:2.0:1784936735.550083:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 192 00000100:00100000:2.0:1784936735.550093:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+29:11071:x1871641503156352:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:2.0:1784936735.550371:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.550388:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.550401:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936735.550490:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1784936735.550514:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000fe760a8 reply state 00000000a2deff07 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936735.550523:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784936735.550563:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1784936735.550928:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+33:11071:x1871641503156352:12345-192.168.204.1@tcp:36:bash.0 Request processed in 836us (1033us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1784936735.550936:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 192 00000020:00080000:2.0:1784936735.550941:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1784936735.552593:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.552606:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.552613:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.552618:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936735.552622:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.552629:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.552645:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936735.552647:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936735.552652:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.552658:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f65b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936735.554393:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.554831:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503156480 00000100:00100000:2.0:1784936735.554842:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503156480 00000100:00100000:2.0:1784936735.554906:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 193 00000100:00100000:2.0:1784936735.554917:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+32:11071:x1871641503156480:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936735.554942:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936735.554964:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f65bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fda expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.555027:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f65bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fda expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.555043:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f65bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fda expref: 33 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.555064:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936735.555068:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784936735.555071:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18000, rc 0) 00000100:00100000:2.0:1784936735.555142:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+33:11071:x1871641503156480:12345-192.168.204.1@tcp:101:bash.0 Request processed in 227us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936735.555150:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 193 00000100:00100000:1.0:1784936735.560165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.560248:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503156608 00000100:00100000:3.0:1784936735.560259:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503156608 00000100:00100000:3.0:1784936735.560344:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:3.0:1784936735.560354:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:11071:x1871641503156608:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:3.0:1784936735.560373:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936735.560409:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fe1 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784936735.560809:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1784936735.561228:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a63f91b, atime: 0x6a63f91a, ctime: 0x6a63f91b, blocks: 0xb 00010000:00010000:1.0:1784936735.561261:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1784936735.561266:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936735.561277:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.561327:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.561341:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4c00, rc 0) 00000100:00100000:1.0:1784936735.561422:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+8:11071:x1871641503156608:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1067us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936735.562282:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1784936735.565822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.566180:0:6601:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503156736 00000100:00100000:3.0:1784936735.566190:0:6601:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503156736 00002000:00010000:3.0:1784936735.566257:0:6601:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1784936735.566262:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9095c31c3480 with x1871641503156736 ext(0->18446744073709551615) 00002000:00010000:3.0:1784936735.566275:0:6601:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9095c31c3480. 00000100:00100000:3.0:1784936735.566321:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1784936735.566330:0:6601:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503156736:12345-192.168.204.1@tcp:10:bash.0 00002000:00010000:3.0:1784936735.566641:0:6601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784936735.566645:0:6601:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784936731 -> 1784936735 00002000:00010000:3.0:1784936735.566647:0:6601:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1784936730 -> 1784936730 00002000:00010000:3.0:1784936735.566649:0:6601:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784936731 -> 1784936735 00002000:00010000:3.0:1784936735.566650:0:6601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784936735.569424:0:6601:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503156736:12345-192.168.204.1@tcp:10:bash.0 Request processed in 3083us (3600us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784936735.569453:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00002000:00010000:3.0:1784936735.569462:0:6601:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1784936735.569466:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9095c31c3480 with x1871641503156736 ext(0->18446744073709551615) 00002000:00010000:3.0:1784936735.569480:0:6601:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9095c31c3480. 00000100:00100000:0.0:1784936735.626453:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524120064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936735.626544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936735.626771:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524120064 00000100:00100000:3.0:1784936735.626780:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524120064 00000100:00100000:3.0:1784936735.626845:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784936735.626854:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524120064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936735.626891:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936735.627032:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524120064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936735.627039:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1784936735.627108:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936735.627150:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524120064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936735.681744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.682960:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503156864 00000100:00100000:3.0:1784936735.682976:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503156864 00000100:00100000:3.0:1784936735.683056:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 194 00000100:00100000:3.0:1784936735.683068:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+33:11559:x1871641503156864:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:3.0:1784936735.683149:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683169:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683180:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683198:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683204:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683211:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683576:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683586:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683593:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936735.683642:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683655:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683677:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683684:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683690:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936735.683694:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683702:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683715:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936735.683718:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936735.683724:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683730:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f65cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683742:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683747:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683759:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683765:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936735.683768:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683774:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683781:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173a200) 00010000:00010000:3.0:1784936735.683784:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936735.683787:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683792:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f65d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683822:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683829:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683834:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683839:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936735.683842:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683859:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683867:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936735.683870:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936735.683872:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.683878:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f65d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936735.683955:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+33:11559:x1871641503156864:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 887us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936735.683964:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 194 00000100:00100000:1.0:1784936735.735025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.735220:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503157120 00000100:00100000:2.0:1784936735.735231:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503157120 00000100:00100000:2.0:1784936735.735298:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 195 00000100:00100000:2.0:1784936735.735309:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+33:11562:x1871641503157120:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936735.735330:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936735.735353:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f65e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fe8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735479:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735495:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735506:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735523:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735530:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735536:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735890:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f65f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735907:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f65f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.735921:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f65f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936735.735932:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784936735.736271:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736279:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736297:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736303:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.736307:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736315:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736329:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936735.736331:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936735.736336:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736342:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f65e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736356:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736369:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736374:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736379:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.736383:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736389:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736397:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d7e59000) 00010000:00010000:2.0:1784936735.736400:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936735.736403:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736408:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f65ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736508:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f65e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe8 expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736524:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f65f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe8 expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.736531:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936735.736533:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784936735.736543:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18600, rc 0) 00000100:00100000:2.0:1784936735.736736:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+35:11562:x1871641503157120:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1427us (1720us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1784936735.736744:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 195 00000100:00100000:0.0:1784936735.745491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.745586:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503157248 00000100:00100000:2.0:1784936735.745599:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503157248 00000100:00100000:2.0:1784936735.745675:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:2.0:1784936735.745686:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+35:11562:x1871641503157248:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1784936735.745759:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.745776:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.745785:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.745818:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.745833:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 35 pid: 5796 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936735.745849:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524120192:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936735.745938:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c64600 going to sleep for 11 seconds 00000100:00100000:2.0:1784936735.748499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936735.748622:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c7cad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524120192:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936735.748654:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936735.751249:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503157504 00000100:00100000:3.0:1784936735.751272:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503157504 00000100:00100000:3.0:1784936735.751797:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:3.0:1784936735.751816:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+36:5588:x1871641503157504:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784936735.752716:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+37:5588:x1871641503157504:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 900us (4222us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1784936735.752728:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:1.0:1784936735.755379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936735.755472:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503157632 00000100:00100000:2.0:1784936735.755481:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503157632 00010000:00010000:2.0:1784936735.755535:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 37 pid: 5796 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936735.755584:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:2.0:1784936735.755594:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+37:2372:x1871641503157632:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936735.755610:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936735.755618:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 37 pid: 5796 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.755631:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 37 pid: 5796 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.755654:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f65a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fd3 expref: 37 pid: 5796 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.755804:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936735.755810:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.755820:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.755828:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.755861:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936735.755971:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+36:2372:x1871641503157632:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 377us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936735.755979:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00010000:00010000:1.0:1784936735.757638:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757652:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757696:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757703:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757710:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757735:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936735.757740:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757748:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757762:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:1.0:1784936735.757764:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936735.757768:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.757774:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936735.757842:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+35:11562:x1871641503157248:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 12155us (12361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936735.757851:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 196 00000100:00100000:0.0:1784936735.762930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.763100:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503157888 00000100:00100000:3.0:1784936735.763111:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503157888 00000100:00100000:3.0:1784936735.763201:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:3.0:1784936735.763211:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+35:11562:x1871641503157888:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:3.0:1784936735.763499:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+36:11562:x1871641503157888:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 289us (578us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1784936735.763525:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:0.0:1784936735.854513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.854676:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503158144 00000100:00100000:3.0:1784936735.854687:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503158144 00000100:00100000:3.0:1784936735.854751:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:3.0:1784936735.854761:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+36:11573:x1871641503158144:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1784936735.854786:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936735.854808:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f660a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94fef expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.857671:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.857697:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.857712:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.857729:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.857736:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.857743:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.860350:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f661f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.860381:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f661f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.860393:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f661f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936735.860406:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1784936735.862124:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862141:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862149:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862155:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936735.862160:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862169:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862186:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936735.862189:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936735.862195:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862201:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f6611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862219:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862238:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862244:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862249:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936735.862252:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862258:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862267:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173a200) 00010000:00010000:3.0:1784936735.862270:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936735.862273:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862290:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862380:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f660a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fef expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862409:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f661f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fef expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.862419:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936735.862422:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936735.862514:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936735.862643:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+38:11573:x1871641503158144:12345-192.168.204.1@tcp:101:cat.0 Request processed in 7881us (8141us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1784936735.862666:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 197 00000100:00100000:2.0:1784936735.868575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936735.868706:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503158400 00000100:00100000:1.0:1784936735.868717:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503158400 00000100:00100000:1.0:1784936735.868780:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:1.0:1784936735.868790:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+38:11573:x1871641503158400:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:1.0:1784936735.869057:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+39:11573:x1871641503158400:12345-192.168.204.1@tcp:35:cat.0 Request processed in 267us (543us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1784936735.869065:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 54 00000100:00100000:1.0:1784936735.941539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936735.941638:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503158656 00000100:00100000:3.0:1784936735.941649:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503158656 00000100:00100000:3.0:1784936735.941725:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 198 00000100:00100000:3.0:1784936735.941735:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+39:11574:x1871641503158656:12345-192.168.204.1@tcp:36:rm.0 00010000:00010000:3.0:1784936735.941988:0:6621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784936735.942018:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f661f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fef expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942042:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f65f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe8 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942054:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f65bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fda expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942063:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936735.942084:0:6621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936735.942106:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942119:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942129:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942155:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942164:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942171:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942502:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942512:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936735.942520:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936735.952374:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1784936735.952399:0:6621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401703969644ns, next at 402703965486ns, rc = 0 00010000:00010000:2.0:1784936735.952518:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952537:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952549:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952559:0:6621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952565:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952572:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952589:0:6621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784936735.952611:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952618:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952624:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952630:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.952634:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952656:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952669:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a100) 00010000:00010000:2.0:1784936735.952671:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784936735.952677:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952683:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f663b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952708:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952715:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952722:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952726:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936735.952729:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952734:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952741:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936735.952743:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936735.952746:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936735.952768:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f662d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936735.952779:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f3eeb4a reply state 000000006277876f transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936735.952789:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784936735.953572:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936735.953581:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936735.953589:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936735.953593:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936735.953600:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936735.953624:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9096d173a100) 00010000:00010000:0.0:1784936735.953627:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784936735.953630:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936735.953636:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936735.953667:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936735.953669:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936735.953671:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936735.954220:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+38:11574:x1871641503158656:12345-192.168.204.1@tcp:36:rm.0 Request processed in 12481us (12685us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784936735.954230:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 198 00010000:00010000:1.0:1784936735.983670:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.983713:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.983721:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.983728:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936735.983733:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.983741:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.983759:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d173a200) 00010000:00010000:1.0:1784936735.983763:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936735.983768:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936735.983774:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f6634 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.012274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936736.012569:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503158912 00000100:00100000:2.0:1784936736.012585:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503158912 00000100:00100000:2.0:1784936736.012660:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 199 00000100:00100000:2.0:1784936736.012671:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+37:11580:x1871641503158912:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936736.012699:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936736.012720:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ff6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.013020:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.013038:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.013049:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.013062:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.013087:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.013094:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936736.022522:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1784936736.026127:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026157:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026172:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026214:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026221:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026243:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026249:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936736.026254:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026263:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026289:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936736.026293:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936736.026298:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026304:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936736.026321:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000553b5b2b reply state 000000009f587b44 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.026333:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784936736.026377:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f6649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 40 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026393:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 39 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.026400:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936736.026402:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936736.026410:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936736.026548:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+40:11580:x1871641503158912:12345-192.168.204.1@tcp:101:bash.0 Request processed in 13877us (14283us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784936736.026558:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 199 00010000:00010000:3.0:1784936736.030415:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.030459:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.030468:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.030475:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936736.030480:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.030491:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.030509:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d7e59000) 00010000:00010000:3.0:1784936736.030512:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936736.030517:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.030524:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6657 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.040982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.041785:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159040 00000100:00100000:0.0:1784936736.041797:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159040 00000100:00100000:0.0:1784936736.041884:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:0.0:1784936736.041895:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+5:2372:x1871641503159040:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936736.041912:0:8072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936736.041934:0:8072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c94ffd expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784936736.041962:0:8072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784936736.041981:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1784936736.041987:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936736.041997:0:8072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 6 pid: 8072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.042024:0:8072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 6 pid: 8072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.042065:0:8072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ba00, rc 0) 00000100:00080000:3.0:1784936736.042303:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936736.042360:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+6:2372:x1871641503159040:12345-192.168.204.1@tcp:101:bash.0 Request processed in 467us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.042367:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:2.0:1784936736.059696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.059819:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159168 00000100:00100000:1.0:1784936736.059828:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159168 00000100:00100000:1.0:1784936736.059895:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:1.0:1784936736.059904:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+6:11580:x1871641503159168:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936736.059924:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936736.059944:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95004 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.059995:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 7 pid: 8072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.060004:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936736.060009:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936736.060014:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.060051:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 7 pid: 8072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.060068:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 7 pid: 8072 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.060082:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6598:1871641524120320:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936736.060187:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784936736.070673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.070872:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159296 00000100:00100000:0.0:1784936736.070884:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159296 00010000:00010000:0.0:1784936736.070929:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 8 pid: 8072 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.070976:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:0.0:1784936736.070987:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503159296:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936736.071003:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936736.071028:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 8 pid: 8072 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.071044:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 8 pid: 8072 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.071070:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936736.071075:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936736.071085:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.071108:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.071160:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.071174:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4efaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5781:1871641524120448:192.168.204.1@tcp:105: 00000100:00100000:0.0:1784936736.071477:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9decc0 going to sleep for 11 seconds 00010000:00010000:2.0:1784936736.071739:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ed5d58/0x6cf7a864723f666c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ffd expref: 8 pid: 8072 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936736.071755:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6598:1871641524120320:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936736.071782:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.071792:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164400, rc 0) 00000100:00100000:2.0:1784936736.071824:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:11580:x1871641503159168:12345-192.168.204.1@tcp:101:bash.0 Request processed in 11921us (12141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936736.071832:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00010000:00010000:0.0:1784936736.072962:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936736.079922:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4efaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5781:1871641524120448:192.168.204.1@tcp:105: 00010000:00010000:2.0:1784936736.079956:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936736.080023:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2371:x1871641503159296:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 9036us (9376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936736.080034:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:2.0:1784936736.083189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936736.083402:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159552 00000100:00100000:3.0:1784936736.083413:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159552 00000100:00100000:3.0:1784936736.083518:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:3.0:1784936736.083550:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+39:11580:x1871641503159552:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:2.0:1784936736.084589:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+40:11580:x1871641503159552:12345-192.168.204.1@tcp:35:bash.0 Request processed in 1036us (1406us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1784936736.084608:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 55 00000100:00100000:1.0:1784936736.185299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.185456:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936736.185606:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159808 00000100:00100000:3.0:1784936736.185616:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159808 00000100:00100000:3.0:1784936736.185684:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:3.0:1784936736.185695:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503159808:12345-192.168.204.1@tcp:16:kworker.0 00000100:00100000:3.0:1784936736.185849:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503159808:12345-192.168.204.1@tcp:16:kworker.0 Request processed in 155us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936736.185856:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:0.0:1784936736.190117:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159680 00000100:00100000:0.0:1784936736.190135:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159680 00002000:00100000:0.0:1784936736.190583:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9096ff396a00 x1871641503159680/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:477/0 lens 504/0 e 0 to 0 dl 1784936747 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936736.190717:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ff396a00 with x1871641503159680 ext(0->8) 00002000:00010000:0.0:1784936736.190724:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9096ff396a00 00000100:00100000:0.0:1784936736.190779:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:0.0:1784936736.190791:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+6:2373:x1871641503159680:12345-192.168.204.1@tcp:4:bash.0 00000100:00100000:0.0:1784936736.192581:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2373:x1871641503159680:12345-192.168.204.1@tcp:4:bash.0 Request processed in 1784us (7425us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784936736.192602:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00002000:00100000:0.0:1784936736.192615:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9096ff396a00 x1871641503159680/t4294967308(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:477/0 lens 504/448 e 0 to 0 dl 1784936747 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936736.192624:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ff396a00 with x1871641503159680 ext(0->8) 00002000:00010000:0.0:1784936736.192629:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9096ff396a00 00000100:00100000:1.0:1784936736.278381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936736.278572:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503159936 00000100:00100000:2.0:1784936736.278594:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503159936 00000100:00100000:2.0:1784936736.278665:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 200 00000100:00100000:2.0:1784936736.278675:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+40:11596:x1871641503159936:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936736.278699:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936736.278721:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f667a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9500b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.278798:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.278813:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.278828:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936736.278896:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1784936736.278900:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936736.278922:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.278958:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f667a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9500b expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.278978:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9500b expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.279008:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936736.279012:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784936736.279015:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19a00, rc 0) 00000100:00100000:2.0:1784936736.279078:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+41:11596:x1871641503159936:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 405us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936736.279085:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 200 00000100:00100000:1.0:1784936736.293063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936736.293319:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503160192 00000100:00100000:3.0:1784936736.293331:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503160192 00000100:00100000:3.0:1784936736.293396:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 201 00000100:00100000:3.0:1784936736.293407:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+41:11596:x1871641503160192:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936736.293462:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936736.293485:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95012 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.293605:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f668f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.293621:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f668f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.293632:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f668f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936736.293644:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784936736.293969:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f6688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95012 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.294005:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f668f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95012 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.294013:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936736.294015:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936736.294019:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4a00, rc 0) 00000100:00100000:3.0:1784936736.294571:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+43:11596:x1871641503160192:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1163us (1517us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1784936736.294579:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 201 00000100:00100000:1.0:1784936736.301890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.301937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936736.302060:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503160448 00000100:00100000:2.0:1784936736.302070:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503160448 00000100:00100000:2.0:1784936736.302132:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 202 00000100:00100000:2.0:1784936736.302142:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+43:11596:x1871641503160448:12345-192.168.204.1@tcp:101:lfs.0 00000100:00100000:3.0:1784936736.302295:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503160576 00000100:00100000:3.0:1784936736.302311:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503160576 00000100:00100000:3.0:1784936736.302358:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1784936736.302365:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+44:2371:x1871641503160576:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936736.302381:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936736.302407:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4a00/0x6cf7a864723f668f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95012 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.302425:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:3.0:1784936736.302469:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936736.302519:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+43:2371:x1871641503160576:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 154us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936736.302539:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00010000:00010000:2.0:1784936736.302864:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936736.302881:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f669d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95019 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.302976:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.302989:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.302999:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936736.303023:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784936736.303146:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f669d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95019 expref: 45 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.303206:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95019 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.303213:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:2.0:1784936736.303216:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784936736.303218:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18c00, rc 0) 00000100:00100000:2.0:1784936736.303248:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+44:11596:x1871641503160448:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 1108us (1369us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1784936736.303255:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 202 00000100:00100000:2.0:1784936736.313693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936736.313839:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503160704 00000100:00100000:3.0:1784936736.313850:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503160704 00000100:00100000:3.0:1784936736.313909:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:3.0:1784936736.313935:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2374:x1871641503160704:12345-192.168.204.1@tcp:1:lfs.0 00010000:00010000:3.0:1784936736.313980:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.314000:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.314009:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1784936736.314014:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936736.314019:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.314053:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.314069:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 8 pid: 6598 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.314083:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6597:1871641524120576:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936736.314671:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936736.321751:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6597:1871641524120576:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936736.321782:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936736.323740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.323890:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503160832 00000100:00100000:0.0:1784936736.323900:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503160832 00010000:00010000:0.0:1784936736.323952:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 9 pid: 6598 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.323999:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:0.0:1784936736.324009:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4649050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503160832:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936736.324026:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784936736.324046:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784936736.324049:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784936736 00002000:00010000:0.0:1784936736.324051:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784936736 00010000:00010000:0.0:1784936736.324057:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 9 pid: 6598 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.324074:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 9 pid: 6598 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.324101:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052ad7cd5/0x6cf7a864723f6673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95004 expref: 9 pid: 6598 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.324118:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936736.324123:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784936736.324129:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.324141:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.324180:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936736.324255:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4649050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503160832:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.324263:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00010000:00010000:1.0:1784936736.325091:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325120:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325151:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325159:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325168:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325177:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936736.325181:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325191:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325205:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.325213:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037d2d1d9/0x6cf7a864723f66b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.325459:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2374:x1871641503160704:12345-192.168.204.1@tcp:1:lfs.0 Request processed in 11523us (11772us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936736.325469:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:2.0:1784936736.334183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.334725:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503161088 00000100:00100000:1.0:1784936736.334738:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503161088 00000100:00100000:1.0:1784936736.334943:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 56 00000100:00100000:1.0:1784936736.334955:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8810850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+44:11596:x1871641503161088:12345-192.168.204.1@tcp:35:lfs.0 00000004:00010000:1.0:1784936736.335026:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95019 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936736.335342:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1784936736.335388:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1784936736.335763:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1784936736.335832:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.335851:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 48 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.335860:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.335897:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 48 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.335913:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 48 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.335947:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1871641524120704:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936736.336047:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784936736.340527:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1871641524120704:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936736.340557:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.350867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.352480:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503161216 00000100:00100000:1.0:1784936736.352494:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503161216 00010000:00010000:1.0:1784936736.352542:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 49 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.352972:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:1.0:1784936736.352984:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+49:2372:x1871641503161216:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936736.353003:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936736.353011:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 49 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.353028:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 49 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.353051:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5000/0x6cf7a864723f665e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ff6 expref: 49 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.353071:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:1.0:1784936736.353077:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.353102:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.353110:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.353145:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936736.353218:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+48:2372:x1871641503161216:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 235us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936736.353226:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00010000:00010000:3.0:1784936736.356907:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.356943:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784936736.357082:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1784936736.357319:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1784936736.357542:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524120832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784936736.357757:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936736.357831:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936736.358908:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524120832 00000100:00100000:1.0:1784936736.358919:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524120832 00000100:00100000:0.0:1784936736.359060:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936736.359070:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5799:x1871641524120832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784936736.359183:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5799:x1871641524120832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.359202:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1784936736.359329:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936736.359489:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524120832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784936736.359973:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1784936736.360057:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524120960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784936736.360112:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936736.360133:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9095c1f1c180 going to sleep for 11 seconds 00000100:00100000:0.0:1784936736.360462:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524120960 00000100:00100000:0.0:1784936736.360469:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524120960 00000100:00100000:0.0:1784936736.360511:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784936736.360519:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5799:x1871641524120960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784936736.360708:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5799:x1871641524120960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (596us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784936736.360716:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784936736.360949:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1871641524120960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784936736.361004:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1784936736.361044:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.361054:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.361061:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.361067:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936736.361081:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.361090:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.361106:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:1.0:1784936736.361109:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784936736.361114:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.361120:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784936736.361318:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784936736.361491:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1784936736.361501:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402113072255ns, next at 403113070317ns, rc = 0 00000001:00080000:1.0:1784936736.361508:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1784936736.361539:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096d173a400) 00010000:00010000:1.0:1784936736.361543:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784936736.361549:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95019 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.361977:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8810850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+51:11596:x1871641503161088:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 27023us (27802us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1784936736.361987:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 56 00000020:00080000:1.0:1784936736.361992:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784936736.366538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.366588:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503161344 00000100:00100000:1.0:1784936736.366597:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503161344 00000100:00100000:1.0:1784936736.366664:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 203 00000100:00100000:1.0:1784936736.366675:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+51:11596:x1871641503161344:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936736.366714:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936736.366741:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f66c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95020 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.366808:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f66c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95020 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.366825:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f66c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95020 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.366844:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936736.366848:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936736.366852:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165400, rc 0) 00000100:00100000:1.0:1784936736.366923:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+52:11596:x1871641503161344:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 249us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936736.366931:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 203 00000100:00100000:2.0:1784936736.370250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.376450:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503161600 00000100:00100000:0.0:1784936736.376467:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503161600 00000100:00100000:0.0:1784936736.376536:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:0.0:1784936736.376547:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+52:11596:x1871641503161600:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:0.0:1784936736.376798:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+53:11596:x1871641503161600:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 252us (6559us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1784936736.376806:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 57 00000100:00100000:2.0:1784936736.493077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.493228:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503161728 00000100:00100000:1.0:1784936736.493315:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503161728 00000100:00100000:1.0:1784936736.493483:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 204 00000100:00100000:1.0:1784936736.493496:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+53:11606:x1871641503161728:12345-192.168.204.1@tcp:34:lfs.0 00010000:00010000:1.0:1784936736.493767:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493795:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493808:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493845:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493853:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493860:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493972:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493981:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.493988:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784936736.494028:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494041:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494047:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494054:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494060:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936736.494064:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494080:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494092:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936736.494095:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936736.494101:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494107:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f66c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494120:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494125:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494131:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494136:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936736.494139:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494145:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494151:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096c7246c00) 00010000:00010000:1.0:1784936736.494153:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936736.494156:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494171:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f66ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494186:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494192:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494197:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494201:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936736.494204:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494210:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494217:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936736.494219:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936736.494222:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.494228:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f66d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.494494:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+53:11606:x1871641503161728:12345-192.168.204.1@tcp:34:lfs.0 Request processed in 999us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936736.494503:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 204 00000100:00100000:3.0:1784936736.540492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936736.540888:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503161984 00000100:00100000:2.0:1784936736.540904:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503161984 00000100:00100000:2.0:1784936736.541040:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 205 00000100:00100000:2.0:1784936736.541053:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+53:11609:x1871641503161984:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936736.541078:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936736.541104:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f66dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95027 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541183:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541198:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541226:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541252:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541261:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541278:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541412:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541420:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541464:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936736.541476:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784936736.541589:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541596:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541602:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541608:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936736.541619:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541627:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541640:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936736.541643:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936736.541648:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.541654:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f66e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543480:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543498:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543505:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543511:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936736.543517:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543525:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543543:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d7e59100) 00010000:00010000:2.0:1784936736.543546:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936736.543570:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543576:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f66ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.543649:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f66dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.545331:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.545349:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936736.545352:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936736.545357:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18c00, rc 0) 00000100:00100000:2.0:1784936736.545480:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+55:11609:x1871641503161984:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 4428us (5003us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1784936736.545491:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 205 00000100:00100000:2.0:1784936736.551790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.551916:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503162112 00000100:00100000:0.0:1784936736.551928:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503162112 00000100:00100000:0.0:1784936736.551990:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 206 00000100:00100000:0.0:1784936736.552001:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+55:11609:x1871641503162112:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1784936736.552092:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552110:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552122:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552153:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552160:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552166:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552172:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936736.552176:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552184:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552196:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936736.552198:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936736.552203:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.552209:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b800/0x6cf7a864723f66ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.552319:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+55:11609:x1871641503162112:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 319us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.552327:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 206 00000100:00100000:0.0:1784936736.569735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936736.570862:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503162368 00000100:00100000:2.0:1784936736.570882:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503162368 00000100:00100000:2.0:1784936736.570981:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:2.0:1784936736.570994:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+55:11609:x1871641503162368:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936736.571382:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+56:11609:x1871641503162368:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 389us (1665us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1784936736.571392:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 58 00000100:00100000:0.0:1784936736.658185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.658260:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503162624 00000100:00100000:0.0:1784936736.658286:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503162624 00000100:00100000:0.0:1784936736.658371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 207 00000100:00100000:0.0:1784936736.658385:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+56:11619:x1871641503162624:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936736.658419:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936736.658423:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784936736.658476:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9500b expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.658499:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:0.0:1784936736.658505:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936736.658525:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6706 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9502e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.658654:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.658670:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.658679:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.658733:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.658751:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 56 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.658770:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c4ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524121088:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936736.658879:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9def00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936736.665730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.665891:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c4ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524121088:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936736.665926:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.668483:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503162752 00000100:00100000:3.0:1784936736.668504:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503162752 00010000:00010000:3.0:1784936736.668565:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 57 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.668619:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:3.0:1784936736.668631:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+57:2372:x1871641503162752:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936736.668857:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936736.668868:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 57 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.668888:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 57 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.668917:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f66f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95027 expref: 57 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.668955:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:3.0:1784936736.668962:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.669233:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.669245:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.669301:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936736.670098:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.670125:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936736.670151:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1784936736.670513:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+57:2372:x1871641503162752:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1879us (4793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936736.670525:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00010000:00010000:2.0:1784936736.671070:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6706 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.671096:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.671107:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936736.671111:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784936736.671115:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b000, rc 0) 00000100:00100000:2.0:1784936736.671167:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+56:11619:x1871641503162624:12345-192.168.204.1@tcp:101:bash.0 Request processed in 12786us (12998us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1784936736.671176:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 207 00000100:00100000:0.0:1784936736.681544:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.681606:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503163008 00000100:00100000:0.0:1784936736.681622:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503163008 00000100:00100000:0.0:1784936736.681704:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 208 00000100:00100000:0.0:1784936736.681716:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+56:11619:x1871641503163008:12345-192.168.204.1@tcp:36:bash.0 00010000:00010000:0.0:1784936736.682288:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.682314:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.682331:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784936736.682403:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1784936736.682455:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff7d90b7 reply state 000000003ffe945d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.682467:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936736.682623:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+59:11619:x1871641503163008:12345-192.168.204.1@tcp:36:bash.0 Request processed in 907us (1095us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1784936736.682745:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 208 00000020:00080000:0.0:1784936736.682752:0:6621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784936736.684942:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.684964:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.684973:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.684981:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936736.684987:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.684997:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.685039:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:3.0:1784936736.685042:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936736.685049:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.685056:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f671b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.694960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.695023:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503163136 00000100:00100000:1.0:1784936736.695038:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503163136 00000100:00100000:1.0:1784936736.695118:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 209 00000100:00100000:1.0:1784936736.695132:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+58:11619:x1871641503163136:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:1.0:1784936736.695175:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936736.695297:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6722 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95035 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.695518:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.695536:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.695547:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.695596:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.695682:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 59 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.695703:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524121216:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936736.695932:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936736.707248:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524121216:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936736.707311:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.707374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.707402:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503163264 00000100:00100000:0.0:1784936736.707411:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503163264 00010000:00010000:0.0:1784936736.707483:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 60 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.707523:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:0.0:1784936736.707533:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+60:2372:x1871641503163264:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936736.707565:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936736.707574:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 60 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707589:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 60 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707618:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f670d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9502e expref: 60 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707644:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936736.707650:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707677:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707686:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707712:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936736.707773:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+59:2372:x1871641503163264:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 240us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.707780:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 79 00010000:00010000:0.0:1784936736.707936:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.707944:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936736.708001:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784936736.708007:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936736.708031:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.708065:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.708083:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.708092:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936736.708095:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936736.708107:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164e00, rc 0) 00000100:00100000:0.0:1784936736.708143:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+58:11619:x1871641503163136:12345-192.168.204.1@tcp:101:bash.0 Request processed in 13016us (13202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.708152:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 209 00000100:00100000:2.0:1784936736.721950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936736.722098:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503163520 00000100:00100000:3.0:1784936736.722113:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503163520 00000100:00100000:3.0:1784936736.722203:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 59 00000100:00100000:3.0:1784936736.722216:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+58:11619:x1871641503163520:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:3.0:1784936736.722621:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+59:11619:x1871641503163520:12345-192.168.204.1@tcp:35:bash.0 Request processed in 407us (685us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1784936736.722871:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 59 00000001:00080000:0.0:1784936736.738992:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1784936736.739014:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1784936736.827841:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936736.828065:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503163648 00000100:00100000:2.0:1784936736.828080:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503163648 00000100:00100000:2.0:1784936736.828167:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:2.0:1784936736.828181:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+59:11626:x1871641503163648:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936736.828221:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936736.828256:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9503c expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.828374:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.828415:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.828480:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936736.828573:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1784936736.828578:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936736.828609:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.828640:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9503c expref: 61 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.828663:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9503c expref: 60 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.828673:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936736.828677:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784936736.828694:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18600, rc 0) 00000100:00100000:2.0:1784936736.828778:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+60:11626:x1871641503163648:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 600us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936736.829074:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 210 00000100:00100000:3.0:1784936736.835947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.839248:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503163776 00000100:00100000:0.0:1784936736.839285:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503163776 00000100:00100000:0.0:1784936736.839509:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 211 00000100:00100000:0.0:1784936736.839525:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+60:11626:x1871641503163776:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936736.839573:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936736.839610:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f673e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95043 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.839704:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.839723:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.839739:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.839756:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.839764:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.839771:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840077:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840087:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840095:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936736.840145:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784936736.840150:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936736.840174:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840188:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840198:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840205:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840212:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840219:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936736.840224:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840233:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.840257:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:0.0:1784936736.843447:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936736.843478:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843493:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f6745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843528:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843537:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843545:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843615:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ae00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936736.843621:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843630:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843652:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096caf90200) 00010000:00010000:0.0:1784936736.843655:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936736.843659:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843666:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ae00/0x6cf7a864723f674c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843770:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b000/0x6cf7a864723f673e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843853:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 61 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.843863:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936736.843866:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784936736.843869:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b400, rc 0) 00000100:00100000:0.0:1784936736.843976:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+61:11626:x1871641503163776:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 4451us (8041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.843988:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 211 00000100:00100000:0.0:1784936736.848016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.848913:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164032 00000100:00100000:1.0:1784936736.848931:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164032 00000100:00100000:1.0:1784936736.849024:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 212 00000100:00100000:1.0:1784936736.849036:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+61:11626:x1871641503164032:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936736.849378:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936736.849409:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f675a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9504a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.855256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:1.0:1784936736.855487:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.855516:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.855525:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.855535:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.855602:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.855628:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 62 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.855658:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524121344:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936736.855813:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.855823:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.855832:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524121472:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936736.855856:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936736.858766:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164160 00000100:00100000:0.0:1784936736.858795:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164160 00010000:00010000:0.0:1784936736.859159:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 63 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936736.859295:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:0.0:1784936736.859308:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+63:2372:x1871641503164160:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936736.859328:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936736.859336:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 63 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.859560:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 63 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.859629:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936736.859635:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.859644:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936736.859651:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936736.859879:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+63:2372:x1871641503164160:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 571us (4637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936736.859889:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00010000:00010000:1.0:1784936736.861821:0:5797:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.1@tcp) returned -22 from blocking AST (req@000000004679ac8b x1871641524121344) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 62 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.861851:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95043 expref: 62 pid: 5798 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936736.861869:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524121344:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936736.863918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.863999:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524121472:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936736.864036:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936736.864045:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.864058:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.864069:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.865470:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164288 00000100:00100000:3.0:1784936736.865488:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164288 00010000:00010000:3.0:1784936736.865611:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936736.865739:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:3.0:1784936736.865752:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+62:2372:x1871641503164288:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936736.865775:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936736.865785:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.865894:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.865924:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164e00/0x6cf7a864723f6729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95035 expref: 62 pid: 5796 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.865946:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:3.0:1784936736.865951:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.865961:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.865983:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936736.866022:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936736.866091:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.866103:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936736.866131:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:3.0:1784936736.866306:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+61:2372:x1871641503164288:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 555us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936736.866313:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00010000:00010000:1.0:1784936736.866717:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f675a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.866738:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.866747:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936736.866751:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784936736.866753:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164000, rc 0) 00000100:00100000:1.0:1784936736.867181:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+61:11626:x1871641503164032:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 18144us (19180us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1784936736.867745:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 212 00000100:00100000:3.0:1784936736.871320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936736.871550:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164544 00000100:00100000:1.0:1784936736.871566:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164544 00000100:00100000:1.0:1784936736.872489:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:1.0:1784936736.872507:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+61:11626:x1871641503164544:12345-192.168.204.1@tcp:103:lfs.0 00010000:00010000:1.0:1784936736.872535:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936736.872569:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f66c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95020 expref: 61 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.873145:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936736.873151:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936736.874137:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+60:11626:x1871641503164544:12345-192.168.204.1@tcp:103:lfs.0 Request processed in 1623us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936736.880467:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:2.0:1784936736.882924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936736.884759:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164672 00000100:00100000:3.0:1784936736.884778:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164672 00000100:00100000:2.0:1784936736.885166:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 213 00000100:00100000:2.0:1784936736.885179:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+60:11626:x1871641503164672:12345-192.168.204.1@tcp:58:lfs.0 00010000:00010000:2.0:1784936736.885331:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.885563:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936736.885578:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936736.885847:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1784936736.886007:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+60:11626:x1871641503164672:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 829us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936736.886016:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 213 00000100:00100000:2.0:1784936736.903855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936736.909810:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164800 00000100:00100000:0.0:1784936736.909832:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164800 00000100:00100000:1.0:1784936736.910722:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 214 00000100:00100000:1.0:1784936736.910736:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+60:11626:x1871641503164800:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:1.0:1784936736.911088:0:6621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936736.911125:0:6621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95051 expref: -99 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.911216:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.911229:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 61 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.911257:0:6621:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.911283:0:6621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 61 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.911300:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936736.911304:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936736.911308:0:6621:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 61 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936736.911336:0:6621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164600, rc 0) 00000100:00100000:1.0:1784936736.912525:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+61:11626:x1871641503164800:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 693us (7877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936736.912551:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 214 00010000:00010000:0.0:1784936737.098197:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936737.162571:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524121600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936737.163054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936737.163314:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524121600 00000100:00100000:3.0:1784936737.163325:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524121600 00000100:00100000:1.0:1784936737.163472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524121856:0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.163517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936737.163541:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784936737.163547:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524121728:0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.163579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936737.163603:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524122240:0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.163852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936737.163886:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524121984:0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.163913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936737.163930:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784936737.163936:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff3cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524122112:0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.163961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936737.163992:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524122112 00000100:00100000:1.0:1784936737.163997:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524122112 00000100:00100000:1.0:1784936737.164044:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784936737.164055:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524122112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936737.164745:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524121856 00000100:00100000:2.0:1784936737.164753:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524121856 00000100:00100000:1.0:1784936737.164781:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524122112:12345-0@lo:400:kworker.0 Request processed in 726us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936737.164793:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784936737.164802:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524121856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936737.164856:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524121856:12345-0@lo:400:kworker.0 Request processed in 55us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936737.164866:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784936737.164888:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524122240 00000100:00100000:2.0:1784936737.164892:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524122240 00000100:00100000:3.0:1784936737.164945:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784936737.164958:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524121600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936737.164978:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784936737.165040:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524121600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.165929:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1784936737.165966:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784936737.165984:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936737.166018:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524121984 00000100:00100000:2.0:1784936737.166026:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524121984 00000100:00100000:1.0:1784936737.166042:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524122112:0@lo:400:kworker.0 00000100:00100000:2.0:1784936737.166066:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784936737.166076:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524122240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784936737.166078:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936737.166104:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524121856:0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.166131:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784936737.166142:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524121984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936737.166173:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1871641524122240:12345-0@lo:400:kworker.0 Request processed in 97us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.166173:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524122240:0@lo:400:kworker.0 00000100:00100000:2.0:1784936737.166190:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784936737.166235:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524121984:12345-0@lo:400:kworker.0 Request processed in 96us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.166244:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784936737.166247:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1784936737.166266:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9095c1eaca80, transno 4294967307 00000100:00100000:1.0:1784936737.166285:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524121984:0@lo:400:kworker.0 00000004:00080000:2.0:1784936737.166286:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1784936737.166326:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fba48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524121600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936737.166345:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524121728 00000100:00100000:1.0:1784936737.166352:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524121728 00000100:00100000:1.0:1784936737.166385:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784936737.166392:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524121728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936737.166458:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3306:x1871641524121728:12345-0@lo:400:kworker.0 Request processed in 66us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.166465:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784936737.166509:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b62e4f62-8046-4b06-8586-527734139351:3306:1871641524121728:0@lo:400:kworker.0 00000100:00100000:3.0:1784936737.175247:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784936737.720380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.720613:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503164928 00000100:00100000:1.0:1784936737.720637:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503164928 00000100:00100000:1.0:1784936737.720719:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 298 00000100:00100000:1.0:1784936737.720733:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503164928:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936737.721314:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2372:x1871641503164928:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 580us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.721344:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 298 00000100:00100000:2.0:1784936737.721613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936737.721787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936737.721807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936737.721835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936737.721898:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165440 00000100:00100000:0.0:1784936737.721906:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165440 00000100:00100000:0.0:1784936737.721961:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165056 00000100:00100000:0.0:1784936737.721964:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165056 00000100:00100000:0.0:1784936737.721986:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 158 00000100:00100000:0.0:1784936737.721994:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503165440:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936737.722093:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165184 00000100:00100000:1.0:1784936737.722097:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165184 00000100:00100000:1.0:1784936737.722128:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165312 00000100:00100000:1.0:1784936737.722132:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165312 00000100:00100000:1.0:1784936737.722156:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:1.0:1784936737.722163:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503165184:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936737.722991:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2372:x1871641503165440:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 991us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936737.723003:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 158 00000100:00100000:0.0:1784936737.723032:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 159 00000100:00100000:0.0:1784936737.723045:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+61:2371:x1871641503165056:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936737.723134:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503165184:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 970us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.723143:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:1.0:1784936737.723160:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:1.0:1784936737.723169:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503165312:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936737.723200:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503165312:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 33us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.723206:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00080000:1.0:1784936737.723269:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784936737.723275:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936737.724265:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+61:2371:x1871641503165056:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 1215us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936737.724298:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 159 00000040:00080000:2.0:1784936737.737161:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936737.737177:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784936737.737225:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1784936737.737232:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784936737.737571:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524122368:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784936737.737752:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936737.742771:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4ac0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524122368:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784936737.745487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.745624:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165568 00000100:00100000:1.0:1784936737.745638:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165568 00000100:00100000:1.0:1784936737.745715:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:1.0:1784936737.745727:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+61:11627:x1871641503165568:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784936737.745778:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784936737.745931:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+61:11627:x1871641503165568:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 205us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.745939:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 215 00000100:00100000:3.0:1784936737.755575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.756543:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165696 00000100:00100000:1.0:1784936737.756560:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165696 00000100:00100000:1.0:1784936737.757067:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:1.0:1784936737.757083:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+61:11627:x1871641503165696:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.757199:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757222:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757241:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757277:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757286:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757294:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757326:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757336:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757344:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936737.757729:0:6621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784936737.757755:0:6621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936737.757775:0:6621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757792:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757799:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757806:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.757812:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936737.758767:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.758781:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.758995:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:1.0:1784936737.758999:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936737.759006:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759013:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f677d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759036:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759042:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759068:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759074:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936737.759077:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759085:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759094:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9096c7246d00) 00010000:00010000:1.0:1784936737.759097:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936737.759100:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759106:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6784 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759128:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759135:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759142:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759147:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936737.759150:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759167:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759176:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936737.759179:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936737.759183:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.759188:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f678b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936737.759382:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+61:11627:x1871641503165696:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 2296us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.759395:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 216 00000100:00100000:2.0:1784936737.783229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.783306:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503165952 00000100:00100000:1.0:1784936737.783324:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503165952 00000100:00100000:1.0:1784936737.783409:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:1.0:1784936737.783421:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+61:11627:x1871641503165952:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.783491:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936737.783523:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6792 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95058 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.783663:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.783683:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.783698:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936737.783734:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784936737.784288:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784300:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784308:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784316:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936737.784322:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784331:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784349:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936737.784352:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784936737.784358:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784365:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784424:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6792 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95058 expref: 63 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784515:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:0.0:1784936737.784519:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936737.784532:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6792 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95058 expref: 63 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.784543:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165600, rc 0) 00000100:00100000:0.0:1784936737.784631:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+62:11627:x1871641503165952:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1212us (1415us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1784936737.784641:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 217 00000100:00100000:2.0:1784936737.792261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936737.792368:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503166080 00000100:00100000:0.0:1784936737.792384:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503166080 00000100:00100000:0.0:1784936737.792499:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:0.0:1784936737.792512:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+62:11627:x1871641503166080:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784936737.792578:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784936737.792742:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+62:11627:x1871641503166080:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 232us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936737.792752:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 218 00000100:00100000:2.0:1784936737.797298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936737.799037:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503166336 00000100:00100000:3.0:1784936737.799063:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503166336 00000100:00100000:3.0:1784936737.799173:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 219 00000100:00100000:3.0:1784936737.799184:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+62:11627:x1871641503166336:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784936737.799218:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936737.799222:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784936737.799276:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f6737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9503c expref: 62 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936737.799299:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:3.0:1784936737.799306:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936737.799323:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f67a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9505f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784936737.800295:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1784936737.801277:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f67ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.801299:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f67ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.801340:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f67ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.801455:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f67a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9505f expref: 64 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.801478:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f67ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9505f expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.801487:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096d7e59700) 00010000:00010000:2.0:1784936737.801491:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936737.801495:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19a00, rc 0) 00000100:00100000:2.0:1784936737.801674:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+63:11627:x1871641503166336:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 2489us (4388us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784936737.801684:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 219 00000100:00100000:2.0:1784936737.814187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936737.814395:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503166592 00000100:00100000:0.0:1784936737.814409:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503166592 00000100:00100000:0.0:1784936737.814527:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:0.0:1784936737.814540:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+63:11627:x1871641503166592:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784936737.814639:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936737.814678:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f67ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9505f expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.814705:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096d7e59700) 00010000:00010000:0.0:1784936737.814721:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936737.814749:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.814790:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.814801:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.815763:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.815781:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.815791:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816127:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816135:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816143:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816150:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936737.816156:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816164:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816177:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:0.0:1784936737.816193:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936737.816199:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816206:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a600/0x6cf7a864723f67bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816220:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816226:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816232:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816238:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26bc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936737.816240:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816257:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816265:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6a6a2264 (ffff9096caf90200) 00010000:00010000:0.0:1784936737.816268:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936737.816270:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.816276:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26bc00/0x6cf7a864723f67c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a6a2264 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936737.816411:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+62:11627:x1871641503166592:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 1868us (2236us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784936737.816454:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 220 00000100:00100000:0.0:1784936737.822012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.822118:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503166720 00000100:00100000:1.0:1784936737.822132:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503166720 00000100:00100000:1.0:1784936737.822211:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 221 00000100:00100000:1.0:1784936737.822224:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fba48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+62:11627:x1871641503166720:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.822266:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936737.822299:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95066 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.822346:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.822364:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.822378:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.822534:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 64 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.822558:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 63 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.822568:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:1.0:1784936737.822571:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784936737.822575:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164400, rc 0) 00000100:00100000:1.0:1784936737.822707:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fba48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+63:11627:x1871641503166720:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 485us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.822723:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 221 00000100:00100000:2.0:1784936737.831168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.832500:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503166976 00000100:00100000:1.0:1784936737.832521:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503166976 00000100:00100000:1.0:1784936737.832608:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 222 00000100:00100000:1.0:1784936737.832633:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+63:11627:x1871641503166976:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.832766:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.832793:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.832809:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784936737.833225:0:6621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1784936737.833238:0:6621:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403584808449ns, next at 404584805068ns, rc = 0 00000004:00010000:1.0:1784936737.833367:0:6621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af22349e reply state 00000000f45e9b44 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936737.833379:0:6621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784936737.833553:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+65:11627:x1871641503166976:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 934us (2399us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1784936737.833562:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 222 00010000:00010000:2.0:1784936737.840131:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.840154:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.840164:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.840171:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936737.840177:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.840202:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.840223:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:2.0:1784936737.840226:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784936737.840231:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.840238:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165400/0x6cf7a864723f67d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936737.840923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.841172:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503167104 00000100:00100000:1.0:1784936737.841186:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503167104 00000100:00100000:1.0:1784936737.841263:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 223 00000100:00100000:1.0:1784936737.841276:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+64:11627:x1871641503167104:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.841314:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936737.841355:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9506d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.841491:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 65 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.841509:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 65 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.841533:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:1.0:1784936737.841536:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936737.841541:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165c00, rc 0) 00000100:00100000:1.0:1784936737.841730:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+65:11627:x1871641503167104:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 456us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.841738:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 223 00000100:00100000:3.0:1784936737.845618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.846107:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503167232 00000100:00100000:1.0:1784936737.846122:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503167232 00000100:00100000:1.0:1784936737.846208:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:1.0:1784936737.846220:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503167232:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784936737.848032:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+10:2372:x1871641503167232:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 1800us (2418us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1784936737.848046:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:3.0:1784936737.851383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936737.857067:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503167488 00000100:00100000:2.0:1784936737.857091:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503167488 00000100:00100000:2.0:1784936737.857197:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:2.0:1784936737.857211:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+65:11627:x1871641503167488:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784936737.857836:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+66:11627:x1871641503167488:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 624us (6465us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1784936737.857847:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 60 00000100:00100000:2.0:1784936737.862043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.862373:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503167744 00000100:00100000:1.0:1784936737.862390:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503167744 00000100:00100000:1.0:1784936737.862511:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:1.0:1784936737.862523:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+66:11627:x1871641503167744:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784936737.862716:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+66:11627:x1871641503167744:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 194us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.862748:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 224 00000100:00100000:3.0:1784936737.869781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.870006:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503167872 00000100:00100000:1.0:1784936737.870021:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503167872 00000100:00100000:1.0:1784936737.870103:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 225 00000100:00100000:1.0:1784936737.870117:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+66:11627:x1871641503167872:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.870149:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936737.870179:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f67e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95074 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.870328:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f67ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.870347:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f67ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.870361:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f67ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936737.870412:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936737.870483:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f67ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.870516:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f67e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95074 expref: 68 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.870551:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f67ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95074 expref: 67 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.870562:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:1.0:1784936737.870574:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784936737.870579:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165200, rc 0) 00000100:00100000:1.0:1784936737.870653:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+67:11627:x1871641503167872:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 538us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.870660:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 225 00000100:00100000:3.0:1784936737.886067:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.886598:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168000 00000100:00100000:1.0:1784936737.886612:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168000 00000100:00100000:1.0:1784936737.886715:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:1.0:1784936737.886729:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+10:2371:x1871641503168000:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.886754:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936737.886785:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9507b expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784936737.886823:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f921, blocks: 0x1 00010000:00010000:1.0:1784936737.886852:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1784936737.886858:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936737.886870:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 11 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.886906:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 11 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.886925:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:1.0:1784936737.887011:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+11:2371:x1871641503168000:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 285us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.887020:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:3.0:1784936737.892097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.892316:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168256 00000100:00100000:1.0:1784936737.892332:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168256 00000100:00100000:1.0:1784936737.892530:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 226 00000100:00100000:1.0:1784936737.892552:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+67:11627:x1871641503168256:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784936737.892733:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+67:11627:x1871641503168256:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 184us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.892742:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 226 00000100:00100000:2.0:1784936737.897480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.897579:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168384 00000100:00100000:1.0:1784936737.897602:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168384 00000100:00100000:1.0:1784936737.897690:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:1.0:1784936737.897703:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+11:11627:x1871641503168384:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936737.897731:0:6595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936737.897757:0:6595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95082 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.897799:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 12 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.897810:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936737.897815:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936737.897821:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.897865:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 12 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.897884:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 12 pid: 6597 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936737.897920:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6595:1871641524122496:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936737.898048:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ac3780 going to sleep for 11 seconds 00000100:00100000:3.0:1784936737.902106:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936737.902347:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168512 00000100:00100000:0.0:1784936737.902360:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168512 00010000:00010000:0.0:1784936737.902414:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 13 pid: 6597 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936737.902513:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:0.0:1784936737.902524:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4648450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+13:2372:x1871641503168512:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936737.902604:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936737.902647:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 13 pid: 6597 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.903111:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 13 pid: 6597 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.903150:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936737.903156:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936737.903168:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 13 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.903181:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 13 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.903235:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 13 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936737.903285:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5783:1871641524122624:192.168.204.1@tcp:105: 00000100:00100000:0.0:1784936737.903387:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9decc0 going to sleep for 11 seconds 00010000:00010000:1.0:1784936737.905148:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000826d911e/0x6cf7a864723f67f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9507b expref: 13 pid: 6597 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936737.905175:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6595:1871641524122496:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936737.905212:0:6595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.905228:0:6595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165800, rc 0) 00000100:00100000:1.0:1784936737.905328:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+12:11627:x1871641503168384:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 7626us (7899us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.905338:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:1.0:1784936737.906704:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5783:1871641524122624:192.168.204.1@tcp:105: 00010000:00010000:1.0:1784936737.906735:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936737.906783:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4648450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+11:2372:x1871641503168512:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 4260us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.906795:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:3.0:1784936737.910859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936737.910972:0:6601:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168640 00000100:00100000:0.0:1784936737.910985:0:6601:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168640 00002000:00100000:0.0:1784936737.911055:0:6601:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9096ff427b80 x1871641503168640/t0(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:478/0 lens 504/0 e 0 to 0 dl 1784936748 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936737.911068:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ff427b80 with x1871641503168640 ext(0->12) 00002000:00010000:0.0:1784936737.911076:0:6601:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096ff427b80 00000100:00100000:0.0:1784936737.911114:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1784936737.911125:0:6601:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+11:2372:x1871641503168640:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784936737.912061:0:6601:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:486efceb-7a20-41d5-8389-4305380725bf+13:2372:x1871641503168640:12345-192.168.204.1@tcp:4:lhsmtool_posix.0 Request processed in 932us (1212us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1784936737.912074:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00002000:00100000:0.0:1784936737.912084:0:6601:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9096ff427b80 x1871641503168640/t4294967320(0) o4->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:478/0 lens 504/448 e 0 to 0 dl 1784936748 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784936737.912095:0:6601:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096ff427b80 with x1871641503168640 ext(0->12) 00002000:00010000:0.0:1784936737.912099:0:6601:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096ff427b80 00000100:00100000:0.0:1784936737.917195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.917349:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168768 00000100:00100000:1.0:1784936737.917364:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168768 00000100:00100000:1.0:1784936737.917532:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 227 00000100:00100000:1.0:1784936737.917545:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+67:11627:x1871641503168768:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784936737.951387:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000020:00080000:2.0:1784936737.951458:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096ec81e0c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784936737.951465:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096edf48000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096ec81e840 00000020:00080000:2.0:1784936737.951469:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096edf48f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096ff38f800 00000001:00080000:2.0:1784936737.951489:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1784936737.951517:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1784936737.951538:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1784936737.951557:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9095c1f1c0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784936737.951560:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096e0358d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9095c1f1cd80 00000020:00080000:2.0:1784936737.951564:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096e0358200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096ef1f1800 00000001:00080000:2.0:1784936737.951585:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1784936737.951659:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1784936737.951687:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1784936737.951909:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524122752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784936737.952010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936737.952077:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524122880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784936737.952106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936737.952130:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784936737.952137:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524123008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784936737.952159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936737.952198:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524122752 00000100:00100000:2.0:1784936737.952207:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524122752 00000100:00100000:2.0:1784936737.952276:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524122880 00000100:00100000:2.0:1784936737.952279:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524122880 00000100:00100000:2.0:1784936737.952291:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524123008 00000100:00100000:2.0:1784936737.952294:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524123008 00000100:00100000:2.0:1784936737.952312:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784936737.952321:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524122752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784936737.952355:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1784936737.952393:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.952421:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 12 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.952468:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784936737.952473:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936737.952478:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.952513:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 12 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.952533:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 12 pid: 6597 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936737.952548:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524123136:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936737.952623:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c64780 going to sleep for 11 seconds 00000100:00100000:2.0:1784936737.952643:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784936737.952651:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524122880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784936737.952846:0:8072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784936737.952850:0:8072:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784936737 00002000:00010000:2.0:1784936737.952852:0:8072:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784936737.952855:0:8072:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784936737 -> 1784936737 00002000:00010000:2.0:1784936737.952858:0:8072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784936737.952909:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1871641524122880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (801us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1784936737.952918:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784936737.952938:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784936737.952952:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524123008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784936737.952968:0:8072:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1784936737.952995:0:8072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a63f920, atime: 0x0, ctime: 0x6a63f920, blocks: 0xb 00010000:00010000:2.0:1784936737.953002:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953012:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1784936737.953016:0:8072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936737.953022:0:8072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953041:0:8072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953053:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953062:0:8072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953083:0:8072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784936737.953767:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1871641524123008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 813us (1604us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784936737.953776:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1784936737.953941:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936737.953950:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953975:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936737.953980:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.953992:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.954011:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.954019:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.954041:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936737.954043:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936737.954044:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784936737.954091:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096edf3fb80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784936737.954099:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524123008:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1784936737.954114:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096edf3e300/2, rc 0, transno 4294967321 00000100:00100000:2.0:1784936737.954119:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524122880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784936737.954519:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+21:11627:x1871641503168768:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 36973us (37338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.954538:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 227 00000020:00080000:3.0:1784936737.954707:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1784936737.954901:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1784936737.963023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.963140:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503168896 00000100:00100000:1.0:1784936737.963155:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503168896 00010000:00010000:1.0:1784936737.963216:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 13 pid: 6597 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936737.963276:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:1.0:1784936737.963288:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+13:2372:x1871641503168896:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936737.963311:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936737.963318:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 13 pid: 6597 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.963337:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 13 pid: 6597 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.963376:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784936737.963381:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784936737.963388:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.963400:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936737.963479:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784936737.963551:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+13:2372:x1871641503168896:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 265us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936737.963581:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:3.0:1784936737.964652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936737.964779:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503169024 00000100:00100000:1.0:1784936737.964788:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503169024 00000100:00100000:1.0:1784936737.964841:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:1.0:1784936737.964853:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+13:2372:x1871641503169024:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1784936737.965272:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014be7fbb/0x6cf7a864723f65c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fe1 expref: 13 pid: 6597 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936737.965293:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524123136:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936737.965337:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.965348:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.965354:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.965365:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.965373:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936737.965397:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936737.966039:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936737.966050:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.966073:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936737.966077:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.966086:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.966106:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.966114:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f7db82/0x6cf7a864723f6802 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936737.966155:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936737.966157:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936737.966159:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936737.973496:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1871641524122752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21165us (21475us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1784936737.973512:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1784936737.973764:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096edf3e680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1784936737.973773:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524122752:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1784936738.013419:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1784936738.013475:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1784936738.013484:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1784936738.014021:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503169024:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 49160us (49364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936738.014035:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:0.0:1784936738.017886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936738.018265:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503169280 00000100:00100000:2.0:1784936738.018279:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503169280 00000100:00100000:2.0:1784936738.018500:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 228 00000100:00100000:2.0:1784936738.018514:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+21:11627:x1871641503169280:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784936738.018812:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936738.018849:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165200/0x6cf7a864723f67ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95074 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.018876:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:2.0:1784936738.018882:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936738.018924:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.018942:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.018955:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784936738.019317:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbd9a9f4 reply state 00000000b91d0cbd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.019330:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936738.023200:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+22:11627:x1871641503169280:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 4671us (5314us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1784936738.023216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 228 00010000:00010000:3.0:1784936738.039991:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.040015:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.040025:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.040033:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936738.040039:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.040049:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.040070:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:3.0:1784936738.040073:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936738.040080:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.040087:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18800/0x6cf7a864723f6810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.040927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936738.041132:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503169408 00000100:00100000:2.0:1784936738.041146:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503169408 00000100:00100000:2.0:1784936738.041217:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:2.0:1784936738.041229:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503169408:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784936738.041604:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784936738.041634:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1784936737 -> 1784936736 00002000:00010000:2.0:1784936738.041637:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784936736 00002000:00010000:2.0:1784936738.041639:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784936737 -> 1784936736 00002000:00010000:2.0:1784936738.041642:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784936738.042484:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503169408:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 1250us (1560us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784936738.042497:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 70 00000100:00100000:1.0:1784936738.047872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936738.048515:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503169664 00000100:00100000:2.0:1784936738.048529:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503169664 00000100:00100000:2.0:1784936738.048679:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:2.0:1784936738.048692:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+21:11627:x1871641503169664:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784936738.048812:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.048835:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.048846:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.048895:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.048916:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 21 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.048933:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524123264:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936738.049063:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936738.056227:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1871641524123264:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936738.056287:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936738.057187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936738.057306:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503169792 00000100:00100000:0.0:1784936738.057318:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503169792 00010000:00010000:0.0:1784936738.057389:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.057506:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:0.0:1784936738.057517:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+22:2371:x1871641503169792:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936738.057539:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936738.057550:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.057911:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.057947:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164400/0x6cf7a864723f67d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95066 expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.057970:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:0.0:1784936738.057977:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.057989:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.057997:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.058033:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936738.058114:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+21:2371:x1871641503169792:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 598us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936738.058123:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00010000:00010000:2.0:1784936738.058199:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058209:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058259:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058268:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058276:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058283:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936738.058287:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058296:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058307:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:2.0:1784936738.058311:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784936738.058315:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.058322:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.058395:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+20:11627:x1871641503169664:12345-192.168.204.1@tcp:55:lhsmtool_posix.0 Request processed in 9705us (10548us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784936738.058405:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 229 00000100:00100000:3.0:1784936738.061177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936738.061456:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503169920 00000100:00100000:2.0:1784936738.061470:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503169920 00000100:00100000:2.0:1784936738.061544:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:2.0:1784936738.061555:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503169920:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784936738.061639:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.061668:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 8 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.061678:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936738.061683:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784936738.061689:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.061750:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 8 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.061923:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 8 pid: 6595 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.061946:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524123392:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936738.062077:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936738.075372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936738.075479:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503170048 00000100:00100000:3.0:1784936738.075493:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503170048 00010000:00010000:3.0:1784936738.075557:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 9 pid: 6595 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936738.075626:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:3.0:1784936738.075662:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503170048:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936738.075685:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936738.075732:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 9 pid: 6595 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.075755:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 9 pid: 6595 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.075791:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936738.075797:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784936738.075806:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.075821:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.075849:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936738.075936:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+9:2372:x1871641503170048:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 276us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936738.075945:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00010000:00010000:2.0:1784936738.076412:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc727ce1/0x6cf7a864723f67fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95082 expref: 8 pid: 6595 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.076482:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6597:1871641524123392:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936738.076521:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076535:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076544:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076579:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076589:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076599:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076607:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936738.076612:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076644:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076659:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.076668:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f681e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.076915:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+7:2372:x1871641503169920:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 15360us (15751us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936738.076927:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 71 00000100:00100000:1.0:1784936738.084069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936738.084214:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503170304 00000100:00100000:3.0:1784936738.084228:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503170304 00000100:00100000:3.0:1784936738.084477:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 230 00000100:00100000:3.0:1784936738.084494:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+20:11627:x1871641503170304:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784936738.084628:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.084674:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.084690:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.084978:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.085004:0:6621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.085014:0:6621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.085065:0:6621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.085084:0:6621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 21 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936738.085104:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524123520:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936738.085226:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ee37bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936738.088803:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524123520:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936738.088847:0:6621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936738.090493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936738.090558:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503170432 00000100:00100000:0.0:1784936738.090600:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503170432 00010000:00010000:0.0:1784936738.090656:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.090714:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:0.0:1784936738.090727:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+22:2371:x1871641503170432:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936738.090749:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936738.090758:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.090777:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.090807:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165c00/0x6cf7a864723f67df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9506d expref: 22 pid: 5798 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.090830:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:0.0:1784936738.090837:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.090849:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.090858:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.090898:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936738.090955:0:6621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936738.090965:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.090983:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:486efceb-7a20-41d5-8389-4305380725bf+21:2371:x1871641503170432:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 257us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936738.091002:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000001:00080000:1.0:1784936738.091302:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1784936738.093003:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1784936738.093099:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1784936738.093228:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524123648:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784936738.093329:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936738.093529:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9de300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936738.093697:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524123648 00000100:00100000:3.0:1784936738.093954:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524123648 00000100:00100000:3.0:1784936738.094031:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936738.094043:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524123648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784936738.094283:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524123648:12345-0@lo:1000:mdt00_003.0 Request processed in 241us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936738.094292:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784936738.094537:0:6621:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1784936738.094546:0:6621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1784936738.094950:0:6621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096edf3e300, transno 4294967321 00000100:00100000:0.0:1784936738.095022:0:6621:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9096edf3e680 x1871641524122752/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784936753 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936738.095039:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524123648:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1784936738.095891:0:6621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1784936738.096002:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524123776:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784936738.096078:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936738.096127:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9ded80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936738.096361:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524123776 00000100:00100000:3.0:1784936738.096370:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524123776 00000100:00100000:3.0:1784936738.096468:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784936738.096481:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c1ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6621:x1871641524123776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784936738.096957:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c1ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6621:x1871641524123776:12345-0@lo:1000:mdt00_003.0 Request processed in 478us (878us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1784936738.096968:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784936738.097209:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff394000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6621:1871641524123776:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784936738.097268:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097282:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097292:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097301:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936738.097323:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097333:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097366:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096c7246d00) 00010000:00010000:0.0:1784936738.097370:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936738.097377:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097385:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5800/0x6cf7a864723f682c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097447:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097454:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097460:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097466:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936738.097469:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097475:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097485:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936738.097488:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784936738.097504:0:6621:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 24 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097518:0:6621:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 24 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097530:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 24 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.097810:0:6621:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 24 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.097830:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d0114700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524123904:192.168.204.1@tcp:105: 00000100:00100000:0.0:1784936738.097926:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9ded80 going to sleep for 11 seconds 00000100:00100000:1.0:1784936738.108079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936738.108174:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503170560 00000100:00100000:3.0:1784936738.108187:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503170560 00000100:00100000:3.0:1784936738.108277:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:3.0:1784936738.108289:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+25:11626:x1871641503170560:12345-192.168.204.1@tcp:49:lfs.0 00000100:00100000:3.0:1784936738.108517:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+25:11626:x1871641503170560:12345-192.168.204.1@tcp:49:lfs.0 Request processed in 228us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936738.108526:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 61 00000100:00100000:2.0:1784936738.110888:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d0114700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6621:1871641524123904:192.168.204.1@tcp:105: 00010000:00010000:2.0:1784936738.110951:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.110966:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f676f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111017:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111034:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111050:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111089:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111096:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111104:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111111:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936738.111116:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111125:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111139:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936738.111143:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936738.111147:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111154:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111164:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111170:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111177:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111188:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936738.111192:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111199:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111208:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936738.111210:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784936738.111213:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.111219:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f6825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936738.111887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936738.112554:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+24:11627:x1871641503170304:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 28060us (28496us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1784936738.112579:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 230 00000020:00080000:2.0:1784936738.112588:0:6621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1784936738.112629:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503170816 00000100:00100000:2.0:1784936738.112639:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503170816 00000100:00100000:2.0:1784936738.112722:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 231 00000100:00100000:2.0:1784936738.112734:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+24:11626:x1871641503170816:12345-192.168.204.1@tcp:58:lfs.0 00000040:00080000:3.0:1784936738.112777:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936738.112784:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936738.113077:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1784936738.113087:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1784936738.113182:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1784936738.113249:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+24:11626:x1871641503170816:12345-192.168.204.1@tcp:58:lfs.0 Request processed in 507us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936738.113257:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 231 00010000:00010000:2.0:1784936738.121153:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936738.122992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936738.125269:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503171072 00000100:00100000:3.0:1784936738.125293:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503171072 00000100:00100000:3.0:1784936738.125480:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 62 00000100:00100000:3.0:1784936738.125494:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8813c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+24:11627:x1871641503171072:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784936738.130333:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784936738.130520:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1784936738.130598:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.130621:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.130638:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.130650:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.130658:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.130666:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936738.130689:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784936738.130869:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8813c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+26:11627:x1871641503171072:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 5370us (7879us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1784936738.130882:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 62 00000020:00080000:3.0:1784936738.130890:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784936738.131350:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936738.131361:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.131371:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936738.131375:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.131384:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.131401:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9096d173a900) 00010000:00010000:0.0:1784936738.131405:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784936738.131411:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.131476:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5600/0x6cf7a864723f683a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.131518:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936738.131520:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936738.131522:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936738.157859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936738.157976:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503171200 00000100:00100000:2.0:1784936738.157991:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503171200 00000100:00100000:2.0:1784936738.158092:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 232 00000100:00100000:2.0:1784936738.158106:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+26:11629:x1871641503171200:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936738.158145:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936738.158177:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95089 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158286:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158314:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158329:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158347:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158356:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158363:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158819:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158832:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158855:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158903:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.158923:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 27 pid: 5797 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936738.158940:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524124032:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936738.159049:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7c64240 going to sleep for 11 seconds 00000100:00100000:2.0:1784936738.163903:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1871641524124032:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936738.163951:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.164227:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936738.164526:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503171456 00000100:00100000:1.0:1784936738.164538:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503171456 00000100:00100000:1.0:1784936738.164679:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:1.0:1784936738.164693:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+28:5588:x1871641503171456:12345-192.168.204.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784936738.165050:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+29:5588:x1871641503171456:12345-192.168.204.1@tcp:35:ldlm_bl.0 Request processed in 359us (823us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1784936738.165060:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 63 00000100:00100000:1.0:1784936738.167617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936738.170219:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503171584 00000100:00100000:0.0:1784936738.170744:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503171584 00010000:00010000:0.0:1784936738.170946:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 29 pid: 5797 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936738.171007:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:0.0:1784936738.171021:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+29:2372:x1871641503171584:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936738.171542:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936738.171555:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 29 pid: 5797 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.171575:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 29 pid: 5797 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.171608:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164000/0x6cf7a864723f6761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9504a expref: 29 pid: 5797 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.171635:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936738.171643:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.172131:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.172141:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936738.172265:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936738.172376:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:486efceb-7a20-41d5-8389-4305380725bf+28:2372:x1871641503171584:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 1355us (4771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936738.172388:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00010000:00010000:2.0:1784936738.176887:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.176911:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936738.176982:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784936738.176988:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936738.177020:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177375:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177419:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177813:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177827:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177836:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936738.177841:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177851:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177875:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:2.0:1784936738.177878:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936738.177885:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177893:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19e00/0x6cf7a864723f6848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177913:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177921:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177927:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177940:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936738.177944:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177951:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177959:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9096d7e59100) 00010000:00010000:2.0:1784936738.177962:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936738.177965:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.177971:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18600/0x6cf7a864723f684f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.178032:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18c00/0x6cf7a864723f6841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95089 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.178384:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95089 expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936738.178393:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936738.178396:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936738.178399:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19a00, rc 0) 00000100:00100000:2.0:1784936738.179003:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+27:11629:x1871641503171200:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 20893us (21154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936738.179015:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 232 00000040:00080000:0.0:1784936739.041165:0:12432:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784936739.041173:0:12432:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784936739.041214:0:12432:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784936739.051274:0:12432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1784936739.144821:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936739.144834:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936739.144875:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784936739.144882:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784936739.145007:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524124160:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784936739.145164:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ee37be40 going to sleep for 11 seconds 00010000:00010000:0.0:1784936739.148383:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936739.152176:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871641524124160:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784936739.152615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936739.153247:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503171712 00000100:00100000:3.0:1784936739.153257:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503171712 00000100:00100000:3.0:1784936739.153332:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:3.0:1784936739.153344:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+27:11641:x1871641503171712:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784936739.153396:0:6621:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1784936739.153621:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936739.154306:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+27:11641:x1871641503171712:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 178us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936739.154316:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 233 00000100:00100000:0.0:1784936739.174747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936739.174907:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503171968 00000100:00100000:2.0:1784936739.174924:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503171968 00000100:00100000:2.0:1784936739.174986:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 234 00000100:00100000:2.0:1784936739.174996:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+27:11641:x1871641503171968:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936739.175018:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936739.175041:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f685d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95090 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936739.175157:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f6864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936739.175173:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f6864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936739.175185:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f6864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936739.175197:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784936739.175341:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19200/0x6cf7a864723f685d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95090 expref: 30 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936739.175359:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f6864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95090 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936739.175369:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936739.175372:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936739.175375:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18000, rc 0) 00000100:00100000:2.0:1784936739.175459:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+29:11641:x1871641503171968:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 463us (722us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1784936739.175467:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 234 00000100:00100000:0.0:1784936739.181273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936739.181331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936739.181406:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503172352 00000100:00100000:0.0:1784936739.181416:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503172352 00000100:00100000:0.0:1784936739.181495:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:0.0:1784936739.181505:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+29:2372:x1871641503172352:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936739.181520:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936739.181545:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18000/0x6cf7a864723f6864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95090 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936739.181561:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936739.181571:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936739.181622:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:486efceb-7a20-41d5-8389-4305380725bf+28:2372:x1871641503172352:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936739.181630:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:1.0:1784936739.182926:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503172224 00000100:00100000:1.0:1784936739.182938:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503172224 00000100:00100000:1.0:1784936739.182995:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 235 00000100:00100000:1.0:1784936739.183004:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d0114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+28:11641:x1871641503172224:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784936739.183083:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183099:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183111:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183324:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183332:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183340:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183346:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936739.183351:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183359:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183370:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936739.183384:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784936739.183389:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936739.183396:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6872 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936739.183999:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d0114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+29:11641:x1871641503172224:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 992us (2731us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1784936739.184008:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 235 00000040:00080000:1.0:1784936739.184129:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936739.184133:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936739.184965:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784936739.184977:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784936739.192526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936739.192591:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503172608 00000100:00100000:3.0:1784936739.192608:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503172608 00000100:00100000:3.0:1784936739.192674:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 64 00000100:00100000:3.0:1784936739.192684:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+29:11641:x1871641503172608:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784936739.192937:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+30:11641:x1871641503172608:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 254us (427us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1784936739.192945:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 64 00010000:00010000:0.0:1784936740.171206:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936740.746910:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784936740.746934:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936740.746999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936740.747100:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524124288 00000100:00100000:3.0:1784936740.747108:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524124288 00000100:00100000:3.0:1784936740.747166:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784936740.747177:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524124288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936740.747228:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936740.747277:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524124288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936740.747284:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784936740.747353:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524124288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784936740.747620:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784936740.920028:0:12483:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784936740.920039:0:12483:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784936740.920086:0:12483:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784936740.920093:0:12483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784936741.082859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936741.082939:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503172864 00000100:00100000:2.0:1784936741.082949:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503172864 00000100:00100000:2.0:1784936741.083041:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 236 00000100:00100000:2.0:1784936741.083051:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+30:11661:x1871641503172864:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936741.083078:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936741.083113:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f6879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95097 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936741.083250:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6880 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936741.083266:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6880 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936741.083280:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6880 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936741.083292:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784936741.083423:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19800/0x6cf7a864723f6879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95097 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936741.083465:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95097 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936741.083474:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:2.0:1784936741.083477:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784936741.083489:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d19000, rc 0) 00000100:00100000:2.0:1784936741.083545:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:486efceb-7a20-41d5-8389-4305380725bf+32:11661:x1871641503172864:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 495us (695us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784936741.083554:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 236 00000100:00080000:0.0:1784936741.083904:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936741.101692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936741.101734:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503172992 00000100:00100000:0.0:1784936741.101744:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503172992 00000100:00100000:0.0:1784936741.101798:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 237 00000100:00100000:0.0:1784936741.101808:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+32:11661:x1871641503172992:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:0.0:1784936741.101881:0:6621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101899:0:6621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101912:0:6621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101940:0:6621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101948:0:6621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101964:0:6621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101970:0:6621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936741.101976:0:6621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101984:0:6621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.101997:0:6621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:0.0:1784936741.102011:0:6621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784936741.102017:0:6621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936741.102025:0:6621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a000/0x6cf7a864723f688e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936741.102098:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+32:11661:x1871641503172992:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 290us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936741.102288:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 237 00000100:00100000:0.0:1784936741.175616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936741.176388:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173120 00000100:00100000:3.0:1784936741.176398:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173120 00000100:00100000:3.0:1784936741.176522:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00100000:3.0:1784936741.176533:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2373:x1871641503173120:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1784936741.176553:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936741.176578:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f6895 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9509e expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784936741.176605:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a63f920, atime: 0x6a63f920, ctime: 0x6a63f920, blocks: 0xb 00010000:00010000:3.0:1784936741.176625:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1784936741.176630:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936741.176640:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f6895 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9509e expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936741.176664:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f6895 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9509e expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936741.176676:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5800, rc 0) 00000100:00100000:3.0:1784936741.176732:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+8:2373:x1871641503173120:12345-192.168.204.1@tcp:101:cat.0 Request processed in 201us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936741.176739:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 72 00000100:00080000:0.0:1784936741.177009:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936741.182323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936741.182581:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173248 00000100:00100000:3.0:1784936741.182592:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173248 00002000:00100000:3.0:1784936741.182643:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9096fb9d5180 x1871641503173248/t0(0) o3->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:482/0 lens 488/0 e 0 to 0 dl 1784936752 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936741.182682:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fb9d5180 with x1871641503173248 ext(0->4095) 00002000:00010000:3.0:1784936741.182688:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096fb9d5180 00000100:00100000:3.0:1784936741.183208:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1784936741.183221:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503173248:12345-192.168.204.1@tcp:3:cat.0 00000100:00100000:3.0:1784936741.183493:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:486efceb-7a20-41d5-8389-4305380725bf+8:2372:x1871641503173248:12345-192.168.204.1@tcp:3:cat.0 Request processed in 274us (1180us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784936741.183502:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00002000:00100000:3.0:1784936741.183509:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9096fb9d5180 x1871641503173248/t0(0) o3->486efceb-7a20-41d5-8389-4305380725bf@192.168.204.1@tcp:482/0 lens 488/4536 e 0 to 0 dl 1784936752 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784936741.183518:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9096fb9d5180 with x1871641503173248 ext(0->4095) 00002000:00010000:3.0:1784936741.183523:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9096fb9d5180 00010000:00010000:0.0:1784936741.194549:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784936741.861119:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1784936742.218747:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936742.280697:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524124416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936742.280779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936742.280881:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524124416 00000100:00100000:3.0:1784936742.280889:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524124416 00000100:00100000:3.0:1784936742.280943:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784936742.280954:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524124416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936742.280993:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936742.281040:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524124416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936742.281046:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1784936742.281071:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936742.281108:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1784936742.281127:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096edf3fb80, transno 4294967310 00000100:00100000:3.0:1784936742.281149:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524124416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936742.282225:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524124928:0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.282268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936742.282296:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936742.282301:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524124800:0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.282326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936742.282356:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524124928 00000100:00100000:3.0:1784936742.282361:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524124928 00000100:00100000:3.0:1784936742.282408:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784936742.282417:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.282481:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524124928:12345-0@lo:400:kworker.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936742.282488:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784936742.282512:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524124800 00000100:00100000:3.0:1784936742.282515:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524124800 00000100:00100000:3.0:1784936742.282538:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784936742.282544:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524124800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.282573:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1871641524124800:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936742.282578:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1784936742.282600:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784936742.282604:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784936742.282623:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524124800:0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.282634:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524124928:0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.282758:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524124544:0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.282792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936742.282836:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524125056:0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.282856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936742.282873:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784936742.282878:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524124672:0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.282896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936742.282917:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125056 00000100:00100000:2.0:1784936742.282921:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125056 00000100:00100000:2.0:1784936742.282945:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524124672 00000100:00100000:2.0:1784936742.282947:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524124672 00000100:00100000:2.0:1784936742.282960:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784936742.282964:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.282995:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524125056:12345-0@lo:400:kworker.0 Request processed in 31us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936742.283001:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784936742.283014:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784936742.283019:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524124672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.283039:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524124672:12345-0@lo:400:kworker.0 Request processed in 22us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936742.283044:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784936742.283069:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524124672:0@lo:400:kworker.0 00000100:00100000:2.0:1784936742.283095:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524125056:0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.283346:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524124544 00000100:00100000:3.0:1784936742.283357:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524124544 00000100:00100000:3.0:1784936742.283395:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784936742.283402:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524124544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936742.283467:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d00b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524124544:12345-0@lo:400:kworker.0 Request processed in 65us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936742.283473:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:3.0:1784936742.283501:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936742.283557:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524124544:0@lo:400:kworker.0 00000100:00100000:1.0:1784936742.837531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936742.837576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936742.837608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936742.837632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936742.837652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936742.837679:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173888 00000100:00100000:1.0:1784936742.837688:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173888 00000100:00100000:1.0:1784936742.837742:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173504 00000100:00100000:1.0:1784936742.837745:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173504 00000100:00100000:1.0:1784936742.837765:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 163 00000100:00100000:1.0:1784936742.837773:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2371:x1871641503173888:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936742.837860:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2371:x1871641503173888:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936742.837868:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 163 00000100:00100000:1.0:1784936742.837885:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:1.0:1784936742.837906:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+32:2371:x1871641503173504:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936742.837937:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+32:2371:x1871641503173504:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936742.837943:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 164 00000100:00100000:1.0:1784936742.837964:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173632 00000100:00100000:1.0:1784936742.837968:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173632 00000100:00100000:1.0:1784936742.837992:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173760 00000100:00100000:1.0:1784936742.837995:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173760 00000100:00100000:1.0:1784936742.838017:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:1.0:1784936742.838026:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503173632:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936742.838069:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+8:2371:x1871641503173632:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936742.838074:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:1.0:1784936742.838085:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:1.0:1784936742.838091:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503173760:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936742.838113:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c5942a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503173760:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 22us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936742.838118:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00080000:1.0:1784936742.838133:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784936742.838138:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936742.839075:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503173376 00000100:00100000:2.0:1784936742.839084:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503173376 00000100:00100000:2.0:1784936742.839133:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 300 00000100:00100000:2.0:1784936742.839141:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503173376:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936742.839195:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503173376:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 54us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936742.839202:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 300 00010000:00010000:0.0:1784936743.240963:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784936743.381043:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1784936743.381057:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1784936743.381064:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1784936743.413766:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:3.0:1784936743.413786:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9096fb9de300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1784936743.413792:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096c8b06600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9096fb9de480 00000020:00080000:3.0:1784936743.413795:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9096c8b06200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9096d46a2800 00000001:00080000:3.0:1784936743.413829:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1784936743.413839:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1784936743.413877:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1784936743.414058:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1784936743.414305:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1784936744.264718:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936745.290382:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936745.864927:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524125184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936745.864996:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936745.865131:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125184 00000100:00100000:2.0:1784936745.865141:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125184 00000100:00100000:2.0:1784936745.865211:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784936745.865221:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524125184:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784936745.865306:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1784936745.865373:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936745.868597:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1784936745.868615:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9096edf3e680, transno 4294967322 00000004:00080000:1.0:1784936745.868632:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1784936745.868665:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524125184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936745.869077:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524125184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3855us (4077us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936745.869087:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784936746.138120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936746.138976:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174016 00000100:00100000:2.0:1784936746.138989:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174016 00000100:00100000:2.0:1784936746.139109:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 238 00000100:00100000:2.0:1784936746.139121:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+19:11306:x1871641503174016:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784936746.139277:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:486efceb-7a20-41d5-8389-4305380725bf+19:11306:x1871641503174016:12345-192.168.204.1@tcp:60:lhsmtool_posix.0 Request processed in 151us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936746.139285:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 238 00000100:00080000:1.0:1784936746.139512:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936746.142290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936746.142571:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174272 00000100:00100000:1.0:1784936746.142582:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174272 00000100:00100000:1.0:1784936746.142694:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 65 00000100:00100000:1.0:1784936746.142708:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+19:11306:x1871641503174272:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784936746.143563:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+20:11306:x1871641503174272:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 854us (1290us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784936746.143574:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 65 00010000:00010000:0.0:1784936746.312650:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936746.416253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936746.416421:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174400 00000100:00100000:3.0:1784936746.416475:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174400 00000100:00100000:3.0:1784936746.416558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 239 00000100:00100000:3.0:1784936746.416571:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:12113:x1871641503174400:12345-192.168.204.1@tcp:101:lsof.0 00010000:00010000:3.0:1784936746.416593:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936746.416618:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f689c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c950a5 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936746.416688:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f68a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936746.416720:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f68a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936746.416732:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f68a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936746.417119:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784936746.417125:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936746.417213:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f68a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936746.417241:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4c00/0x6cf7a864723f689c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950a5 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936746.417258:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f68a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950a5 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936746.417341:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:3.0:1784936746.417345:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936746.417348:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4200, rc 0) 00000100:00100000:3.0:1784936746.417412:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:12113:x1871641503174400:12345-192.168.204.1@tcp:101:lsof.0 Request processed in 844us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936746.417420:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 239 00000100:00080000:1.0:1784936746.417967:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784936747.340079:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936747.400895:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524125312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936747.400976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936747.401079:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125312 00000100:00100000:3.0:1784936747.401087:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125312 00000100:00080000:1.0:1784936747.401191:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936747.401636:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524125568:0@lo:400:kworker.0 00000100:00100000:0.0:1784936747.401677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936747.401703:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936747.401709:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524125696:0@lo:400:kworker.0 00000100:00100000:0.0:1784936747.401732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936747.401815:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524125824:0@lo:400:kworker.0 00000100:00100000:1.0:1784936747.401847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936747.401867:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784936747.401873:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524125440:0@lo:400:kworker.0 00000100:00100000:1.0:1784936747.401898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936747.401918:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fb9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524125952:0@lo:400:kworker.0 00000100:00100000:1.0:1784936747.401944:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125824 00000100:00100000:1.0:1784936747.401949:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125824 00000100:00100000:1.0:1784936747.401990:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784936747.402000:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524125824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936747.402072:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524125824:12345-0@lo:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936747.402096:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784936747.402120:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125440 00000100:00100000:1.0:1784936747.402124:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125440 00000100:00100000:3.0:1784936747.402188:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784936747.402207:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524125312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936747.402239:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936747.402273:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524125312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936747.402280:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1784936747.402326:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936747.405324:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125568 00000100:00100000:3.0:1784936747.405335:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125696 00000100:00100000:0.0:1784936747.405340:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125568 00000100:00100000:3.0:1784936747.405343:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125696 00000100:00100000:3.0:1784936747.405408:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784936747.405415:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784936747.405422:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524125696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936747.405446:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524125568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936747.405596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936747.405667:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524125568:12345-0@lo:400:kworker.0 Request processed in 234us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936747.405676:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784936747.405692:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524125952 00000100:00100000:0.0:1784936747.405695:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524125952 00000100:00100000:0.0:1784936747.405712:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784936747.405718:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524125952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936747.405752:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524125952:12345-0@lo:400:kworker.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936747.405758:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784936747.406210:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524125568:0@lo:400:kworker.0 00000100:00100000:1.0:1784936747.406618:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1784936747.406632:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524125440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936747.406685:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524125440:12345-0@lo:400:kworker.0 Request processed in 57us (4785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936747.406692:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1784936747.406714:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936747.407471:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524125696:12345-0@lo:400:kworker.0 Request processed in 2052us (5734us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936747.407481:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784936747.407720:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524125952:0@lo:400:kworker.0 00000100:00100000:2.0:1784936747.407733:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524125824:0@lo:400:kworker.0 00000100:00100000:2.0:1784936747.407754:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524125312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936747.407778:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524125440:0@lo:400:kworker.0 00000100:00100000:0.0:1784936747.407869:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fb9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524125696:0@lo:400:kworker.0 00000100:00100000:0.0:1784936747.963687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936747.963762:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936747.963798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936747.963849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936747.963871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936747.963911:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174656 00000100:00100000:0.0:1784936747.963922:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174656 00000100:00100000:0.0:1784936747.963968:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175040 00000100:00100000:0.0:1784936747.963971:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175040 00000100:00100000:0.0:1784936747.963989:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:0.0:1784936747.963998:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+20:2371:x1871641503174656:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936747.964091:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:486efceb-7a20-41d5-8389-4305380725bf+20:2371:x1871641503174656:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 91us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936747.964098:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 168 00000100:00100000:0.0:1784936747.964115:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:0.0:1784936747.964121:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2371:x1871641503175040:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936747.964145:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2371:x1871641503175040:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936747.964151:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 169 00000100:00100000:1.0:1784936747.964181:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174912 00000100:00100000:1.0:1784936747.964188:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174912 00000100:00100000:1.0:1784936747.964246:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174784 00000100:00100000:1.0:1784936747.964250:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174784 00000100:00100000:1.0:1784936747.964275:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:1.0:1784936747.964283:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503174912:12345-192.168.204.1@tcp:400:kworker.0 00000100:00080000:0.0:1784936747.964285:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936747.964292:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936747.964313:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:1.0:1784936747.964323:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:486efceb-7a20-41d5-8389-4305380725bf+5:2371:x1871641503174912:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 39us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936747.964325:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503174784:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936747.964338:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 90 00000100:00100000:0.0:1784936747.964366:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2371:x1871641503174784:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 42us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936747.964374:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:3.0:1784936747.964597:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503174528 00000100:00100000:3.0:1784936747.964602:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503174528 00000100:00100000:3.0:1784936747.964640:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 302 00000100:00100000:3.0:1784936747.964648:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503174528:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936747.964676:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2371:x1871641503174528:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936747.964682:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 302 00010000:00010000:0.0:1784936748.362751:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784936748.425201:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936748.425212:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936748.425861:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1784936748.425869:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1784936748.470596:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1784936748.470619:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1784936748.470693:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1784936748.470724:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1784936749.387115:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784936750.174023:0:12685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:45:48 (1784936748) 00010000:00010000:3.0:1784936750.409329:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936750.984845:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524126080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936750.984923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936750.985138:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126080 00000100:00100000:2.0:1784936750.985146:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126080 00000100:00100000:2.0:1784936750.985211:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784936750.985221:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524126080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784936750.985256:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936750.985306:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524126080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936750.985313:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784936750.985360:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524126080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784936750.985514:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784936751.433596:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936752.456898:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936752.520748:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096edf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524126208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936752.520821:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936752.520900:0:6599:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126208 00000100:00100000:1.0:1784936752.520907:0:6599:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126208 00000100:00100000:1.0:1784936752.520975:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784936752.520984:0:6599:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524126208:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784936752.521005:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1784936752.521034:0:6599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936752.521086:0:6599:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524126208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936752.521093:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784936752.521158:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096edf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524126208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936752.521872:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524126592:0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.521914:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936752.521939:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936752.521944:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524126720:0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.521977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936752.522005:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126592 00000100:00100000:3.0:1784936752.522009:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126592 00000100:00100000:3.0:1784936752.522065:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784936752.522076:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.522118:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524126592:12345-0@lo:400:kworker.0 Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936752.522124:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784936752.522142:0:6597:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126720 00000100:00100000:3.0:1784936752.522146:0:6597:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126720 00000100:00100000:3.0:1784936752.522173:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784936752.522179:0:6597:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524126720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.522209:0:6597:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524126720:12345-0@lo:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936752.522214:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1784936752.522235:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784936752.522239:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936752.522259:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524126720:0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.522268:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524126592:0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522475:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524126336:0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936752.522621:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524126848:0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936752.522668:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784936752.522682:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524126464:0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936752.522733:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126848 00000100:00100000:2.0:1784936752.522737:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126848 00000100:00100000:2.0:1784936752.522762:0:6621:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126464 00000100:00100000:2.0:1784936752.522765:0:6621:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126464 00000100:00100000:2.0:1784936752.522780:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784936752.522786:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524126848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522822:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524126848:12345-0@lo:400:kworker.0 Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936752.522828:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784936752.522840:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784936752.522847:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524126464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522873:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524126464:12345-0@lo:400:kworker.0 Request processed in 27us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936752.522879:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784936752.522904:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524126464:0@lo:400:kworker.0 00000100:00100000:2.0:1784936752.522915:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524126848:0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.524379:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126336 00000100:00100000:3.0:1784936752.524391:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126336 00000100:00100000:3.0:1784936752.524492:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784936752.524502:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524126336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936752.524666:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+19:3305:x1871641524126336:12345-0@lo:400:kworker.0 Request processed in 165us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936752.524673:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1784936752.524714:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936752.525704:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524126336:0@lo:400:kworker.0 00000100:00100000:0.0:1784936753.080783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936753.080822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936753.080848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936753.080873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936753.080891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936753.080960:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175424 00000100:00100000:3.0:1784936753.080968:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175424 00000100:00100000:3.0:1784936753.081036:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175552 00000100:00100000:3.0:1784936753.081040:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175552 00000100:00100000:3.0:1784936753.081065:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:3.0:1784936753.081073:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2373:x1871641503175424:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936753.081142:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+7:2373:x1871641503175424:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 69us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936753.081149:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:3.0:1784936753.081163:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:3.0:1784936753.081168:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503175552:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936753.081186:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2373:x1871641503175552:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 18us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936753.081192:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:3.0:1784936753.081308:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175680 00000100:00100000:3.0:1784936753.081312:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175680 00000100:00100000:3.0:1784936753.081333:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175296 00000100:00100000:3.0:1784936753.081336:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175296 00000100:00100000:3.0:1784936753.081351:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:3.0:1784936753.081356:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2373:x1871641503175680:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936753.081382:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2373:x1871641503175680:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936753.081403:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 173 00000100:00100000:3.0:1784936753.081414:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 174 00000100:00100000:3.0:1784936753.081419:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fb9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+19:2373:x1871641503175296:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936753.081507:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fb9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+19:2373:x1871641503175296:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 87us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936753.081513:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 174 00000100:00100000:2.0:1784936753.081732:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175168 00000100:00100000:2.0:1784936753.081736:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175168 00000100:00100000:2.0:1784936753.081768:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 304 00000100:00100000:2.0:1784936753.081774:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503175168:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936753.081799:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2373:x1871641503175168:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 25us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936753.081813:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 304 00000100:00080000:0.0:1784936753.082033:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784936753.082038:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936753.082041:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784936753.480738:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936753.481781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936753.484209:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503175936 00000100:00100000:1.0:1784936753.484226:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503175936 00000100:00100000:1.0:1784936753.484499:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:1.0:1784936753.484580:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+19:12334:x1871641503175936:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:1.0:1784936753.485753:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+20:12334:x1871641503175936:12345-192.168.204.1@tcp:35:umount.0 Request processed in 1237us (3973us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1784936753.485764:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 66 00000100:00100000:2.0:1784936753.489448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936753.489599:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503176192 00000100:00100000:3.0:1784936753.489610:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503176192 00000100:00100000:3.0:1784936753.489848:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:3.0:1784936753.489865:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+20:12334:x1871641503176192:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:3.0:1784936753.490286:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+21:12334:x1871641503176192:12345-192.168.204.1@tcp:35:umount.0 Request processed in 426us (872us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1784936753.490295:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 67 00000100:00100000:0.0:1784936753.494111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936753.494214:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503176448 00000100:00100000:1.0:1784936753.494226:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503176448 00000100:00100000:1.0:1784936753.494491:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:1.0:1784936753.494502:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8811050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+21:12334:x1871641503176448:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:1.0:1784936753.495140:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8811050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:486efceb-7a20-41d5-8389-4305380725bf+22:12334:x1871641503176448:12345-192.168.204.1@tcp:35:umount.0 Request processed in 638us (1037us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1784936753.495148:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 68 00000100:00100000:0.0:1784936753.498725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936753.498821:0:5800:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503176704 00000100:00100000:3.0:1784936753.498908:0:5800:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503176704 00000100:00100000:3.0:1784936753.499018:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:3.0:1784936753.499030:0:5800:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+22:12334:x1871641503176704:12345-192.168.204.1@tcp:35:umount.0 00000100:00100000:3.0:1784936753.499477:0:5800:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:486efceb-7a20-41d5-8389-4305380725bf+23:12334:x1871641503176704:12345-192.168.204.1@tcp:35:umount.0 Request processed in 447us (820us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1784936753.499486:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 69 00000100:00100000:2.0:1784936753.506178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936753.506275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936753.507216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936753.507269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936753.507358:0:6598:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503177216 00000100:00100000:3.0:1784936753.507369:0:6598:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503177216 00000100:00100000:3.0:1784936753.507450:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 73 00000100:00100000:3.0:1784936753.507462:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+5:2370:x1871641503177216:12345-192.168.204.1@tcp:9:umount.0 00000020:00000080:3.0:1784936753.507513:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5bf3 00000100:00080000:3.0:1784936753.507525:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9096ee266000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784936753.507563:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1784936753.508177:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:486efceb-7a20-41d5-8389-4305380725bf+2:2370:x1871641503177216:12345-192.168.204.1@tcp:9:umount.0 Request processed in 715us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936753.508187:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 73 00010000:00010000:3.0:1784936753.508221:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936753.512604:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503176832 00000100:00100000:0.0:1784936753.512622:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503176832 00000100:00100000:0.0:1784936753.512737:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503177088 00000100:00100000:0.0:1784936753.512742:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503177088 00000100:00100000:0.0:1784936753.512768:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1784936753.512779:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4648c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+14:2374:x1871641503176832:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936753.512796:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936753.512816:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fda00/0x6cf7a864723f591b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c30 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936753.512852:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936753.512925:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4648c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+13:2374:x1871641503176832:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 147us (6756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936753.512933:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1784936753.512998:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:0.0:1784936753.513020:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+12:2372:x1871641503177088:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936753.513028:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936753.513038:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26a400/0x6cf7a864723f5b05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cfb expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936753.513047:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936753.513067:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2372:x1871641503177088:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 49us (6792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936753.513073:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:2.0:1784936753.515036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936753.515116:0:6595:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503177600 00000100:00100000:3.0:1784936753.515126:0:6595:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503177600 00000100:00100000:3.0:1784936753.515188:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 74 00000100:00100000:3.0:1784936753.515200:0:6595:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+7:2370:x1871641503177600:12345-192.168.204.1@tcp:9:umount.0 00000020:00000080:3.0:1784936753.515243:0:6595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5e54 00000020:00010000:3.0:1784936753.515254:0:6595:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9096c8bc4000: total 0 00000100:00080000:3.0:1784936753.515259:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9096c8bc7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784936753.515302:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1784936753.515611:0:6595:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:486efceb-7a20-41d5-8389-4305380725bf+5:2370:x1871641503177600:12345-192.168.204.1@tcp:9:umount.0 Request processed in 413us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936753.515619:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 74 00000020:00010000:3.0:1784936753.515747:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9096c8bc4000: total 0 00010000:00010000:3.0:1784936753.515773:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9096c8bc4000, canceled 0 locks, left on hash table 2. 00000100:00100000:0.0:1784936753.516267:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503176960 00000100:00100000:0.0:1784936753.516274:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503176960 00000100:00100000:0.0:1784936753.516328:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:0.0:1784936753.516336:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+11:2374:x1871641503176960:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784936753.516349:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936753.516359:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d19c00/0x6cf7a864723f5881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94bf8 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936753.516373:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936753.516402:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2374:x1871641503176960:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 67us (9133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936753.516410:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00010000:00010000:3.0:1784936753.517542:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a46bace9/0x6cf7a864723f61f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ed0 expref: 4 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936753.517630:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fadb720/0x6cf7a864723f6895 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9509e expref: 3 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936753.517649:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9096c8bc4000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1784936753.517713:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936753.517716:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936753.517718:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936753.530771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936753.530869:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503178624 00000100:00100000:3.0:1784936753.530879:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503178624 00000100:00100000:3.0:1784936753.530958:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 240 00000100:00100000:3.0:1784936753.530968:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+23:2370:x1871641503178624:12345-192.168.204.1@tcp:39:umount.0 00000020:00000080:3.0:1784936753.531002:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f588f 00000020:00010000:3.0:1784936753.531019:0:5798:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9096ef1e7800: total 0 00000100:00080000:3.0:1784936753.531024:0:5798:0:(import.c:65:import_set_state_nolock()) ffff9096ef1e4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784936753.531053:0:5798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1784936753.531467:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:486efceb-7a20-41d5-8389-4305380725bf+22:2370:x1871641503178624:12345-192.168.204.1@tcp:39:umount.0 Request processed in 498us (704us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1784936753.531476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 240 00000020:00010000:1.0:1784936753.532575:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9096ef1e7800: total 0 00010000:00010000:1.0:1784936753.532586:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936753.532643:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9096ef1e7800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1784936753.532680:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:1.0:1784936753.532685:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936753.532697:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164a00/0x6cf7a864723f6259 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94eec expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532745:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c7246900) 00010000:00010000:1.0:1784936753.532749:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936753.532753:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f5b75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d10 expref: 20 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532771:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936753.532774:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784936753.532778:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19000/0x6cf7a864723f6880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95097 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532791:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:1.0:1784936753.532793:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784936753.532797:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18400/0x6cf7a864723f61aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ebb expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532807:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:1.0:1784936753.532809:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784936753.532812:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165a00/0x6cf7a864723f61e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ec9 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532835:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936753.532838:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936753.532842:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19a00/0x6cf7a864723f6856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95089 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532856:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936753.532859:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784936753.532869:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d18e00/0x6cf7a864723f6554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94fc5 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532884:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936753.532886:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784936753.532891:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19400/0x6cf7a864723f5eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94df7 expref: 14 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532903:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:1.0:1784936753.532905:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936753.532909:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c13fd400/0x6cf7a864723f5b59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d09 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532923:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:1.0:1784936753.532925:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936753.532928:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b600/0x6cf7a864723f60d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94e83 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532939:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9096caf90b00) 00010000:00010000:1.0:1784936753.532940:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936753.532954:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea5c00/0x6cf7a864723f61d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ec2 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532972:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9096caf90d00) 00010000:00010000:1.0:1784936753.532974:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784936753.532977:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f5bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94d25 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.532990:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9096c7246a00) 00010000:00010000:1.0:1784936753.532998:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936753.533003:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164600/0x6cf7a864723f6776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95051 expref: 9 pid: 6621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.533020:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9096d7e59200) 00010000:00010000:1.0:1784936753.533023:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784936753.533026:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f4d19600/0x6cf7a864723f6275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94ef3 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936753.533037:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9096ef1e7800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1784936753.533049:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936753.533051:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936753.533053:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784936753.609732:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:1.0:1784936753.609747:0:6623:0:(genops.c:906:class_export_put()) final put ffff9096c8bc4000/486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:1.0:1784936753.609786:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c8bc4000/486efceb-7a20-41d5-8389-4305380725bf for lustre-OST0000 00000020:00000080:1.0:1784936753.609850:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096c8bc7800 for lustre-OST0000 00000001:00080000:3.0:1784936753.654277:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1784936753.654417:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000001:00080000:3.0:1784936753.654467:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1784936753.654477:0:5818:0:(genops.c:906:class_export_put()) final put ffff9096ef1e7800/486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:0.0:1784936753.654706:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1e7800/486efceb-7a20-41d5-8389-4305380725bf for lustre-MDT0000 00000020:00000080:0.0:1784936753.654777:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1e4800 for lustre-MDT0000 00010000:00010000:3.0:1784936754.505949:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936755.086242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936755.088988:0:5781:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503178752 00000100:00100000:3.0:1784936755.089008:0:5781:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503178752 00000100:00100000:3.0:1784936755.089100:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:3.0:1784936755.089122:0:5781:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2373:x1871641503178752:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936755.089141:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936755.089163:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9097021ed000/0x6cf7a864723f5961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c45 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936755.089183:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936755.096758:0:5781:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:2373:x1871641503178752:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 7635us (10513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936755.096774:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:0.0:1784936755.101464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936755.101621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936755.101652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936755.101858:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503179264 00000100:00100000:3.0:1784936755.101867:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503179264 00000100:00100000:3.0:1784936755.101942:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 241 00000100:00100000:3.0:1784936755.101953:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+6:2370:x1871641503179264:12345-192.168.204.1@tcp:39:umount.0 00000020:00000080:3.0:1784936755.102010:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5976 00000020:00010000:3.0:1784936755.102019:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9096edf2c000: total 0 00000100:00080000:3.0:1784936755.102024:0:5796:0:(import.c:65:import_set_state_nolock()) ffff9096edf2f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784936755.102046:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1784936755.102709:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cb536a61-e7ff-45d6-aca9-5836b499d8d1+5:2370:x1871641503179264:12345-192.168.204.1@tcp:39:umount.0 Request processed in 756us (1052us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784936755.102718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 241 00000100:00100000:3.0:1784936755.102745:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503178880 00000100:00100000:3.0:1784936755.102751:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503178880 00000100:00100000:3.0:1784936755.102780:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503179008 00000100:00100000:3.0:1784936755.102783:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503179008 00000100:00100000:3.0:1784936755.102799:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1784936755.102804:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d96f7a08-a761-4b50-baa8-3dae75dc18da+10:2373:x1871641503178880:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936755.102816:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936755.102835:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9097021ec200/0x6cf7a864723f5968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c6f expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936755.102853:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936755.102872:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d96f7a08-a761-4b50-baa8-3dae75dc18da+9:2373:x1871641503178880:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 67us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936755.102878:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1784936755.102902:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:3.0:1784936755.102908:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5043480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d96f7a08-a761-4b50-baa8-3dae75dc18da+8:2373:x1871641503179008:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936755.102925:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936755.102935:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fcc00/0x6cf7a864723f5afe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94cf4 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936755.102945:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936755.102963:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5043480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d96f7a08-a761-4b50-baa8-3dae75dc18da+7:2373:x1871641503179008:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 55us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936755.102969:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000020:00010000:1.0:1784936755.103089:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9096edf2c000: total 0 00010000:00010000:1.0:1784936755.103134:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9096edf2c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784936755.103158:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246f00) 00010000:00010000:1.0:1784936755.103161:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936755.103167:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096d9ea4200/0x6cf7a864723f68a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950a5 expref: 4 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936755.103186:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9096edf2c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784936755.103195:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936755.103197:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936755.103199:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784936755.103415:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936755.142256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936755.142384:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503179520 00000100:00100000:1.0:1784936755.142409:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503179520 00000100:00100000:1.0:1784936755.142508:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 305 00000100:00100000:1.0:1784936755.142520:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+7:2370:x1871641503179520:12345-192.168.204.1@tcp:251:umount.0 00000020:00000080:1.0:1784936755.142585:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f586c 00000020:00010000:1.0:1784936755.142593:0:5788:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9096ef1e0000: total 0 00000100:00080000:1.0:1784936755.142598:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9096ef1e3000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784936755.142687:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d96f7a08-a761-4b50-baa8-3dae75dc18da+3:2370:x1871641503179520:12345-192.168.204.1@tcp:251:umount.0 Request processed in 168us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936755.142698:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 305 00000020:00010000:3.0:1784936755.142709:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9096ef1e0000: total 0 00010000:00010000:3.0:1784936755.142722:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936755.142815:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9096ef1e0000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784936755.143170:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031a00/0x6cf7a864723f5922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c94c37 expref: 2 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936755.143189:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9096ef1e0000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1784936755.143209:0:5784:0:(genops.c:906:class_export_put()) final put ffff9096ef1e0000/d96f7a08-a761-4b50-baa8-3dae75dc18da 00010000:00010000:1.0:1784936755.143272:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936755.143275:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936755.143277:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784936755.144187:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1e0000/d96f7a08-a761-4b50-baa8-3dae75dc18da for MGS 00000020:00000080:0.0:1784936755.144406:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1e3000 for MGS 00010000:00010000:1.0:1784936755.530219:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936756.106946:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524126976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936756.107064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936756.108663:0:6600:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524126976 00000100:00100000:1.0:1784936756.108680:0:6600:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524126976 00000100:00100000:1.0:1784936756.108767:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784936756.108780:0:6600:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524126976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936756.108835:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936756.108957:0:6600:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524126976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936756.108966:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1784936756.109012:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936756.109347:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524126976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936756.552834:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784936757.175051:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:3.0:1784936757.175063:0:7508:0:(genops.c:906:class_export_put()) final put ffff9096ee263000/486efceb-7a20-41d5-8389-4305380725bf 00000020:00000080:2.0:1784936757.175157:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ee263000/486efceb-7a20-41d5-8389-4305380725bf for lustre-OST0001 00000020:00000080:2.0:1784936757.176091:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ee266000 for lustre-OST0001 00000020:01000004:1.0:1784936757.176384:0:12885:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784936757.191653:0:12885:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784936757.191725:0:12885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.191744:0:12885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.191752:0:12885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.191760:0:12885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.191799:0:12885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784936757.191806:0:12885:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784936757.191838:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784936757.191843:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784936757.191851:0:12885:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784936757.191895:0:12885:0:(import.c:65:import_set_state_nolock()) ffff9096e0614800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784936757.191968:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936757.191978:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.191987:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0030e00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936757.191991:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.192002:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936757.192011:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936757.192018:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784936757.192021:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784936757.192024:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784936757.192059:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.192093:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936757.192135:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.192142:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0030e00/0x6cf7a864723f58f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58f8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.192160:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936757.192163:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936757.192167:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936757.192179:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936757.192206:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524127232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936757.192304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936757.192399:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127232 00000100:00100000:2.0:1784936757.192408:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127232 00000100:00100000:2.0:1784936757.192505:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784936757.192515:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+19:3308:x1871641524127232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936757.192535:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936757.192553:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f58f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f58f1 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.192570:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936757.192613:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b62e4f62-8046-4b06-8586-527734139351+18:3308:x1871641524127232:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936757.192621:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784936757.192675:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524127232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936757.192927:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524127104:0@lo:39:umount.0 00000100:00100000:3.0:1784936757.192976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936757.193170:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127104 00000100:00100000:2.0:1784936757.193187:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127104 00000100:00100000:2.0:1784936757.193237:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784936757.193245:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1871641524127104:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784936757.193280:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f567b 00000100:00080000:2.0:1784936757.193293:0:5798:0:(import.c:65:import_set_state_nolock()) ffff9096ef117800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784936757.193387:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1871641524127104:12345-0@lo:39:umount.0 Request processed in 142us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936757.193395:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1784936757.193407:0:5798:0:(genops.c:906:class_export_put()) final put ffff9096c9b8b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784936757.193465:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c9b8b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784936757.193524:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef117800 for lustre-MDT0000 00000100:00080000:2.0:1784936757.193561:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096e0614800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784936757.193572:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524127104:0@lo:39:umount.0 00010000:00010000:1.0:1784936757.193699:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784936757.193716:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784936757.193720:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784936757.193726:0:12885:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784936757.195114:0:12885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195135:0:12885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195143:0:12885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195169:0:12885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195193:0:12885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936757.195202:0:12885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195208:0:12885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195215:0:12885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195222:0:12885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195297:0:12885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784936757.195306:0:12885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195312:0:12885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195318:0:12885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.195324:0:12885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196080:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784936757.196093:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196103:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fc800 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936757.196107:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196118:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936757.196154:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936757.196161:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784936757.196164:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1784936757.196215:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196222:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936757.196257:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196265:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fc800/0x6cf7a864723f58ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5906 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196282:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936757.196286:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196292:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0030400 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936757.196295:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196302:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936757.196309:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936757.196315:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784936757.196323:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784936757.196326:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784936757.196343:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196350:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936757.196367:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196374:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0030400/0x6cf7a864723f5826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f582d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196391:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936757.196396:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196402:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a800 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936757.196405:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196412:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936757.196418:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936757.196425:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784936757.196443:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784936757.196456:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196462:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936757.196476:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196485:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936757.196487:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936757.196489:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936757.196505:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936757.196532:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524127360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936757.196626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936757.196690:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524127488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936757.196716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936757.196737:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936757.196742:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524127616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936757.196765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936757.196797:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127360 00000100:00100000:3.0:1784936757.196805:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127360 00000100:00100000:3.0:1784936757.196853:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127488 00000100:00100000:3.0:1784936757.196856:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127488 00000100:00100000:3.0:1784936757.196869:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127616 00000100:00100000:3.0:1784936757.196871:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127616 00000100:00100000:3.0:1784936757.196902:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784936757.196912:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4649450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+20:3307:x1871641524127360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784936757.196929:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936757.196945:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4e00/0x6cf7a864723f5906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f58ff expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.196964:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936757.197002:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4649450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+19:3307:x1871641524127360:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936757.197020:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784936757.197078:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784936757.197085:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+18:3305:x1871641524127488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784936757.197093:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936757.197102:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0030000/0x6cf7a864723f582d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f5826 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.197114:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936757.197141:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+17:3305:x1871641524127488:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936757.197148:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784936757.197160:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784936757.197166:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+16:3305:x1871641524127616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784936757.197173:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936757.197182:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f5b2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f5b28 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936757.197190:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936757.197210:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+15:3305:x1871641524127616:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936757.197216:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784936757.197256:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524127616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936757.197265:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524127488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936757.197291:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524127360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936757.197642:0:12885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784936757.197653:0:12885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096ee26a800/0x6cf7a864723f5b28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5b2f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936757.197666:0:12885:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784936757.197677:0:12885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.197685:0:12885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.197692:0:12885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.197699:0:12885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936757.197711:0:12885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784936757.197714:0:12885:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1784936757.197717:0:12885:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1784936757.197758:0:12885:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784936757.197765:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1784936757.197772:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784936757.197780:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1784936757.197787:0:12885:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9096c83ae000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784936757.197793:0:12885:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9096ff894800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784936757.197801:0:12885:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9096edf2c000 cb536a61-e7ff-45d6-aca9-5836b499d8d1 192.168.204.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784936757.197806:0:12885:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9096c70919c0) has exports, disconnecting them 00000020:00080000:1.0:1784936757.197835:0:12885:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9096c83ae000), last request at 1784936752 00000020:00000080:1.0:1784936757.197844:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f57ee 00000100:00080000:1.0:1784936757.197867:0:12885:0:(import.c:65:import_set_state_nolock()) ffff9096ef1e4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784936757.197933:0:12885:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9096c83ae000): rc 0 00000020:00000080:1.0:1784936757.197936:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096c83ae000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784936757.197960:0:12885:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9096ff894800), last request at 1784936752 00000020:00000080:1.0:1784936757.197964:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5723 00000100:00080000:1.0:1784936757.197974:0:12885:0:(import.c:65:import_set_state_nolock()) ffff9096ff895800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784936757.197981:0:12885:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9096ff894800): rc 0 00000020:00000080:1.0:1784936757.197983:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096ff894800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1784936757.197991:0:12885:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3a5c2d3bae0 00000100:00080000:1.0:1784936757.198018:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784936757.198022:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1784936757.198035:0:12885:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784936757.198105:0:12885:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:0.0:1784936757.198304:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c83ae000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784936757.198361:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ff894800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784936757.198402:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1e4000 for lustre-MDT0000 00000020:00000080:0.0:1784936757.198406:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ff895800 for lustre-MDT0000 00000100:00080000:1.0:1784936757.198502:0:12885:0:(import.c:65:import_set_state_nolock()) ffff9096f4d00000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784936757.198528:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784936757.198531:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1784936757.198547:0:12885:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784936757.198610:0:12885:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784936757.198620:0:12885:0:(import.c:65:import_set_state_nolock()) ffff9096fb2db800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784936757.198656:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9096c70919c0) has no exports 00000100:00100000:0.0:1784936757.198713:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524127744:0@lo:9:umount.0 00000100:00100000:0.0:1784936757.198778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936757.198829:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524127872:0@lo:9:umount.0 00000100:00100000:0.0:1784936757.198851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936757.198902:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127744 00000100:00100000:0.0:1784936757.198911:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127744 00000100:00100000:0.0:1784936757.198956:0:8072:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524127872 00000100:00100000:0.0:1784936757.198959:0:8072:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524127872 00000100:00100000:0.0:1784936757.198994:0:8072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784936757.199002:0:8072:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1871641524127744:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784936757.199034:0:8072:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f577e 00000100:00080000:0.0:1784936757.199041:0:8072:0:(import.c:65:import_set_state_nolock()) ffff9096ff5ae800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784936757.199076:0:8072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1784936757.199255:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784936757.199264:0:6598:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1871641524127872:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784936757.199279:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5857 00000100:00080000:1.0:1784936757.199285:0:6598:0:(import.c:65:import_set_state_nolock()) ffff9096ef1ee000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784936757.199307:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1784936757.199718:0:6598:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3304:x1871641524127872:12345-0@lo:9:umount.0 Request processed in 454us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936757.199742:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784936757.200081:0:8072:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3304:x1871641524127744:12345-0@lo:9:umount.0 Request processed in 1079us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936757.200089:0:8072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784936757.200249:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936757.200296:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096f4d00000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784936757.200311:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784936757.200313:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784936757.200317:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524127744:0@lo:9:umount.0 00000100:00080000:0.0:1784936757.200331:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096fb2db800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784936757.200336:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784936757.200337:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784936757.200339:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524127872:0@lo:9:umount.0 00010000:00010000:2.0:1784936757.200510:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936757.200521:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.200533:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fde00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936757.200538:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.200550:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936757.200557:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936757.200564:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784936757.200567:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784936757.200578:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784936757.200929:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936757.201389:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.201400:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936757.201455:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.201464:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fde00/0x6cf7a864723f55da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f55e1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936757.201488:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784936757.201506:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096fbbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524128000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936757.201574:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936757.201629:0:5782:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128000 00000100:00100000:2.0:1784936757.201638:0:5782:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128000 00000100:00100000:2.0:1784936757.201690:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784936757.201699:0:5782:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+15:3308:x1871641524128000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936757.201714:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936757.201733:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4000/0x6cf7a864723f55e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f55da expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936757.201768:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936757.201804:0:5782:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b62e4f62-8046-4b06-8586-527734139351+14:3308:x1871641524128000:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936757.201811:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784936757.201864:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096fbbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b62e4f62-8046-4b06-8586-527734139351:3308:1871641524128000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936757.201895:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936757.201897:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936757.201908:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784936757.210831:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9096c70919c0) has no exports 00000020:00000080:1.0:1784936757.257789:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5635 00000020:00000080:1.0:1784936757.257807:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096ef114800/lustre-QMT0000_UUID 00000020:01000000:1.0:1784936757.257927:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784936757.257974:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef114800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784936757.258025:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936757.258041:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784936757.258046:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9096c8a8cd40) has no exports 00000020:00000080:0.0:1784936757.258413:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f562e 00000020:00000080:0.0:1784936757.258421:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096ef100800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784936757.258617:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef100800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784936757.258705:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936757.258716:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784936757.258720:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096ef105800/lustre-QMT0000_UUID 00000020:00000080:0.0:1784936757.258722:0:12885:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef105800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784936757.258727:0:12885:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1784936757.576760:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936757.643025:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524128384:0@lo:400:kworker.0 00000100:00100000:0.0:1784936757.643135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936757.643229:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936757.643369:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936757.643382:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524128128:0@lo:400:kworker.0 00000100:00100000:3.0:1784936757.643445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936757.643490:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128128 00000100:00100000:3.0:1784936757.643500:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128128 00000100:00100000:3.0:1784936757.643569:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784936757.643580:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:3307:x1871641524128128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936757.643643:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c7c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b62e4f62-8046-4b06-8586-527734139351+14:3307:x1871641524128128:12345-0@lo:400:kworker.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936757.643651:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784936757.643714:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524128128:0@lo:400:kworker.0 00000100:00100000:3.0:1784936757.643753:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128384 00000100:00100000:3.0:1784936757.643757:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128384 00000100:00100000:3.0:1784936757.643780:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784936757.643785:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1871641524128384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784936757.643791:0:5796:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784936757.643823:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1871641524128384:12345-0@lo:400:kworker.0 Request processed in 37us (689us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784936757.643829:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784936757.644167:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524128256:0@lo:400:kworker.0 00000100:00100000:0.0:1784936757.644208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936757.644470:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128256 00000100:00100000:2.0:1784936757.644477:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128256 00000100:00100000:2.0:1784936757.644511:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1784936757.644519:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1871641524128256:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784936757.644526:0:5798:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784936757.644564:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1871641524128256:12345-0@lo:400:kworker.0 Request processed in 45us (354us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784936757.644571:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1784936757.644824:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784936757.644831:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784936757.644835:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784936757.659085:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784936757.659105:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 231 00000100:00080000:0.0:1784936757.659120:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9096ef1eb000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936757.659183:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096f5041f80 x1871641524128512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936757.660065:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1871641524128384:0@lo:400:kworker.0 00000100:00080000:0.0:1784936757.660140:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784936757.660147:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9096ff890800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784936757.660151:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784936757.660157:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9096ff890800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784936757.660160:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:0.0:1784936757.660166:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9096ff890800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936757.660204:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096f5042680 x1871641524128640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936757.660216:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1871641524128256:0@lo:400:kworker.0 00000100:00100000:2.0:1784936757.660602:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524128512:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784936757.660699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936757.660736:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1871641524128640:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784936757.660761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936757.661115:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128512 00000100:00100000:3.0:1784936757.661125:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128512 00000100:00100000:3.0:1784936757.661172:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128640 00000100:00100000:3.0:1784936757.661176:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128640 00000100:00100000:3.0:1784936757.661212:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1784936757.661222:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096fbbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524128512:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1784936757.661261:0:5796:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784936757.664381:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096fbbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524128512:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 3144us (3666us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784936757.664418:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784936757.664630:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1784936757.664640:0:6621:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1871641524128640:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1784936757.664663:0:6621:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784936757.664700:0:6621:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1871641524128640:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 62us (3940us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784936757.664706:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1784936757.665154:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784936757.665161:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784936757.665166:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524128512:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1784936757.665179:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096ff890800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784936757.665193:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784936757.665197:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1871641524128640:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1784936758.600702:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784936758.738153:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000001:00080000:2.0:1784936758.738180:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1784936758.738188:0:5818:0:(genops.c:906:class_export_put()) final put ffff9096edf2c000/cb536a61-e7ff-45d6-aca9-5836b499d8d1 00000020:00000080:2.0:1784936758.738218:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096edf2c000/cb536a61-e7ff-45d6-aca9-5836b499d8d1 for lustre-MDT0000 00000020:00000080:2.0:1784936758.738291:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096edf2f000 for lustre-MDT0000 00000001:00100000:1.0:1784936758.747191:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784936758.747204:0:6623:0:(genops.c:906:class_export_put()) final put ffff9096ff5a9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784936758.747366:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ff5a9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1784936758.747472:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ff5ae800 for lustre-OST0000 00000020:01000000:0.0:1784936759.304896:0:12885:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9095c1efade0 - data ffff9096ffc6a0d8/ffff9096e8d8a000 00000020:01000000:0.0:1784936759.305082:0:12885:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9096c9b079c0 - data ffff9096d13356c0/ffff9096ef0fd000 00000001:00000004:0.0:1784936759.321138:0:12885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1784936759.413182:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784936759.413197:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1784936759.413223:0:12885:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784936759.413226:0:12885:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784936759.418276:0:7044:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784936759.418288:0:7044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1784936759.418305:0:7044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1784936759.420719:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784936759.420730:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1784936759.420756:0:12885:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784936759.420759:0:12885:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784936759.421857:0:7794:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784936759.421864:0:7794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1784936759.421881:0:7794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1784936759.522492:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f55fd 00000020:00000080:0.0:1784936759.522506:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096f4ace800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784936759.523334:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5612 00000020:00000080:0.0:1784936759.523340:0:12885:0:(genops.c:906:class_export_put()) final put ffff9097019f9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784936759.523346:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784936759.523352:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936759.523360:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784936759.523364:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9096c7094d40) has no exports 00000004:01000000:0.0:1784936759.523538:0:12885:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784936759.523546:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5850 00000020:00000080:0.0:1784936759.523550:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096ef1e6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784936759.523554:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784936759.523558:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936759.523564:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784936759.523566:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9096c9b63380) has no exports 00000020:00000080:0.0:1784936759.523571:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5849 00000020:00000080:0.0:1784936759.523575:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096fb2d9800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784936759.523920:0:12885:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784936759.523924:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784936759.523928:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1784936759.523933:0:12885:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784936759.523935:0:12885:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784936759.523965:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936759.523972:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784936759.523976:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5769 00000020:00000080:0.0:1784936759.523993:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096ff5ac000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784936759.524000:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784936759.524003:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936759.524007:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784936759.524009:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9096ff8819c0) has no exports 00000020:00000080:0.0:1784936759.524013:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5762 00000020:00000080:0.0:1784936759.524015:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096f4d04800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1784936759.524319:0:12885:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784936759.524322:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784936759.524325:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1784936759.524328:0:12885:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784936759.524330:0:12885:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784936759.524353:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936759.524358:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784936759.524380:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936759.524383:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784936759.524407:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5619 00000020:00000080:0.0:1784936759.524410:0:12885:0:(genops.c:906:class_export_put()) final put ffff9097019f9800/lustre-MDD0000_UUID 00000020:01000000:0.0:1784936759.524414:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784936759.524417:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936759.524420:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784936759.524422:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9096c7093380) has no exports 00000020:00000080:0.0:1784936759.524462:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936759.524466:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784936759.524469:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5620 00000020:00000080:0.0:1784936759.524472:0:12885:0:(genops.c:906:class_export_put()) final put ffff9097019fb800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784936759.524480:0:12885:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096d473e000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784936759.524483:0:12885:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096d473e000 3 00000020:01000004:0.0:1784936759.524486:0:12885:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9096d473e000 from lustre-MDT0000 00000020:00000080:0.0:1784936759.524506:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936759.524510:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784936759.524513:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096f4ace000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784936759.524515:0:12885:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4ace000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784936759.524528:0:12885:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784936759.524590:0:12885:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1784936759.524595:0:12885:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784936759.524598:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784936759.524600:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936759.524603:0:12885:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784936759.524610:0:12885:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9096c5822000 b62e4f62-8046-4b06-8586-527734139351 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784936759.524615:0:12885:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9096c8a8b380) has exports, disconnecting them 00000020:00080000:0.0:1784936759.524618:0:12885:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9096c5822000), last request at 1784936529 00000020:00000080:0.0:1784936759.524631:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f55be 00000020:00010000:0.0:1784936759.524635:0:12885:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9096c5822000: total 8 00000100:00080000:0.0:1784936759.524638:0:12885:0:(import.c:65:import_set_state_nolock()) ffff9096c5825800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784936759.524657:0:12885:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9096c5822000): rc 0 00000020:00080000:0.0:1784936759.524661:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9096c8a8b380) has no exports 00000100:00100000:0.0:1784936759.524726:0:5791:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff9096d01b5000:5791] 2 exiting: rc = 0 00000100:00100000:0.0:1784936759.524800:0:5788:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff9096d0d2f600:5788] 0 exiting: rc = 1 00000020:00000080:3.0:1784936759.525249:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4ace800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784936759.525264:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9097019f9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1784936759.525268:0:36:0:(genops.c:906:class_export_put()) final put ffff9096f4aca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784936759.525270:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4aca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784936759.525274:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784936759.525388:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1e6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784936759.525395:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096fb2d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784936759.525400:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096fb2db800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784936759.525404:0:36:0:(genops.c:906:class_export_put()) final put ffff9096ff35b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784936759.525406:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ff35b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784936759.525409:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784936759.525464:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ff5ac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784936759.525474:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4d04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784936759.525477:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096f4d00000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784936759.525482:0:36:0:(genops.c:906:class_export_put()) final put ffff9096c83ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784936759.525484:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c83ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784936759.525487:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784936759.525556:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9097019f9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784936759.525568:0:36:0:(genops.c:906:class_export_put()) final put ffff9096f4acd000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784936759.525570:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4acd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784936759.525575:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784936759.525738:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9097019fb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1784936759.526033:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9096c5822000: total 0 00010000:00010000:1.0:1784936759.526064:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9096c5822000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1784936759.526094:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f56d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f56cf expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526138:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d18200/0x6cf7a864723f58c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f58b9 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526151:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fc000/0x6cf7a864723f58ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f58c7 expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526162:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4800/0x6cf7a864723f58dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f58d5 expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526172:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031c00/0x6cf7a864723f58ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f58e3 expref: 5 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526183:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fca00/0x6cf7a864723f5b13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f5b0c expref: 4 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526193:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c13fd600/0x6cf7a864723f5b21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f5b1a expref: 3 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526237:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c0031800/0x6cf7a864723f5914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6cf7a864723f590d expref: 2 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936759.526247:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9096c5822000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1784936759.526262:0:5784:0:(genops.c:906:class_export_put()) final put ffff9096c5822000/b62e4f62-8046-4b06-8586-527734139351 00010000:00010000:1.0:1784936759.526281:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936759.526283:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936759.526285:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784936759.526417:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c5822000/b62e4f62-8046-4b06-8586-527734139351 for MGS 00000020:00000080:3.0:1784936759.526469:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096c5825800 for MGS 00000100:00100000:2.0:1784936759.526657:0:5790:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff9096d0d2f400:5790] 1 exiting: rc = 0 00000100:00100000:0.0:1784936759.527010:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527020:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527026:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527032:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527038:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527044:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527049:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527055:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527061:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527066:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527073:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527080:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527085:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527091:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527096:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527102:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527174:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527183:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527188:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527194:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527526:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527535:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527542:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527548:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527608:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527614:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527619:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527625:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527630:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527635:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527640:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527645:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527650:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527655:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527660:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527665:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527670:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527676:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527682:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527688:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527693:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527699:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527708:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527714:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527720:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527725:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527730:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527736:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527741:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527747:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527752:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527768:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527773:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527778:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527783:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527788:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527794:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527800:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527805:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527811:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527817:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527822:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527837:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936759.527843:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1784936759.528518:0:12885:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784936759.528523:0:12885:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1784936759.529492:0:12885:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9095c1efaa20 - data ffff9096ffe5f360/ffff9096e8d88400 00000020:01000000:0.0:1784936759.529703:0:12885:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9096c9b07b40 - data ffff9096eaf551b0/ffff9096c70f9400 00000020:00000080:0.0:1784936759.530740:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f55a2 00000020:00000080:0.0:1784936759.530751:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096d7afc000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784936759.530766:0:12885:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096d473e000 from MGS, refs=2 00000020:01000004:0.0:1784936759.530770:0:12885:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096d473e000 2 00000020:01000004:0.0:1784936759.530773:0:12885:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9096d473e000 from MGS 00000020:00000080:0.0:1784936759.530794:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936759.530801:0:12885:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784936759.530804:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096c5537800/MGS 00000020:00000080:0.0:1784936759.530806:0:12885:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c5537800/MGS for MGS 00000020:01000000:0.0:1784936759.530816:0:12885:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784936759.530888:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784936759.530893:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936759.530898:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784936759.530905:0:12885:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9096e0617000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784936759.530911:0:12885:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9096d0c04d40) has exports, disconnecting them 00000020:00080000:0.0:1784936759.530916:0:12885:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9096e0617000), last request at 1784936530 00000020:00000080:0.0:1784936759.530930:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f566d 00000020:00080000:0.0:1784936759.530941:0:12885:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9096e0617000): rc 0 00000020:00000080:0.0:1784936759.530946:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096e0617000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784936759.532058:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096d7afc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784936759.532079:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096e0617000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1784936759.532712:0:12885:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784936759.532717:0:12885:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784936759.532721:0:12885:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784936759.532727:0:12885:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784936759.532869:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784936759.532877:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1784936759.532884:0:12885:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096d473e000 1 00000020:00000080:1.0:1784936759.532890:0:12885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f5594 00000020:00000080:1.0:1784936759.532896:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096c5534800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1784936759.532901:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1784936759.532906:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784936759.532910:0:12885:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784936759.532913:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9096c9b619c0) has no exports 00000020:00000080:3.0:1784936759.533111:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096e0614800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784936759.533119:0:11837:0:(genops.c:906:class_export_put()) final put ffff9096c9b89000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784936759.533121:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c9b89000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784936759.533126:0:11837:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784936759.533194:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c5534800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784936759.554113:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784936759.554128:0:12885:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784936759.554133:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096d473e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784936759.554137:0:12885:0:(genops.c:865:class_export_destroy()) destroying export ffff9096d473e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784936759.554145:0:12885:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784936759.554327:0:12885:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9096d4738000 00000020:01000000:1.0:1784936759.554358:0:12885:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784936759.554361:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784936759.554365:0:12885:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784936759.554369:0:12885:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9096c7090000) has no exports 00000100:00100000:2.0:1784936759.555956:0:5798:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff9096c70eb400:5798] 2 exiting: rc = 0 00000100:00100000:2.0:1784936759.556216:0:5797:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff9096d0d9c600:5797] 1 exiting: rc = 0 00000100:00100000:1.0:1784936759.559298:0:6621:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff9096ff9ea400:6621] 3 exiting: rc = 0 00000100:00100000:3.0:1784936759.559973:0:5796:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff9096d7eeb800:5796] 0 exiting: rc = 1 00000100:00100000:1.0:1784936759.561623:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561631:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561637:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561642:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561648:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561653:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561658:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561664:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561669:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561674:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561679:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561684:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561696:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561702:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561708:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561713:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561718:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561723:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561728:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561733:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561737:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561743:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561748:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561753:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561758:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561763:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561774:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561780:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561791:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561796:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561813:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561819:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561825:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561841:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561846:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561851:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561857:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561863:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561868:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561874:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561880:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561893:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561900:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561906:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561912:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561917:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561922:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561927:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561932:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561937:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561942:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561948:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561954:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561959:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561966:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561971:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561977:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561982:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561989:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.561994:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.562006:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.562012:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.562017:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.562023:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569029:0:5799:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9096c661b000:5799] 0 exiting: rc = 1 00000100:00100000:3.0:1784936759.569236:0:5800:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9096c70ea600:5800] 1 exiting: rc = 0 00000100:00100000:1.0:1784936759.569366:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569373:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569379:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569385:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569393:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569401:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569406:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569413:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569419:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569444:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569451:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569458:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569465:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569471:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569476:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569480:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569485:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569490:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569494:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569499:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569504:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569509:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569515:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569520:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569529:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569535:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569540:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569545:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569569:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569576:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569582:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569588:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569594:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569599:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569604:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569618:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569624:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569629:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569634:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569639:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569643:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569648:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569655:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569660:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569666:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569671:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569677:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569682:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569687:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569693:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569698:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569704:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569710:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569715:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569720:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569726:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569731:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569736:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569741:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569746:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569751:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569756:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569761:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.569767:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.570888:0:5802:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff9096c8a2a400:5802] 1 exiting: rc = 0 00000100:00100000:2.0:1784936759.571169:0:5801:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff9096c8a2bc00:5801] 0 exiting: rc = 1 00000100:00100000:1.0:1784936759.571787:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571795:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571803:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571810:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571818:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571850:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571856:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571863:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571873:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571879:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571885:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571891:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571897:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571903:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571909:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571929:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571937:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571943:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571950:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571957:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571965:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571972:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571979:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571986:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571992:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.571999:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572007:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572030:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572038:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572044:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572053:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572124:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572133:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572141:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572148:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572177:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572185:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572194:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572333:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572358:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572371:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572377:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572384:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572390:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572395:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572401:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572409:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572416:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572423:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572450:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572456:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572476:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572483:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572489:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572494:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572499:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572505:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572511:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572517:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572523:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572529:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572533:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.572542:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.573412:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936759.585287:0:5803:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9096c70e6e00:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1784936759.586133:0:5804:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9096c70e7e00:5804] 1 exiting: rc = 0 00000100:00100000:1.0:1784936759.586791:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586798:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586804:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586810:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586816:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586820:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586825:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586840:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586845:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586850:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586855:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586876:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586881:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586886:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586891:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586896:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586902:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586907:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586912:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586917:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586921:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586926:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586931:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586935:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586941:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586945:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586950:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586955:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586959:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586964:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586969:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586974:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586979:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586985:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586990:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586995:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.586999:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587005:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587010:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587015:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587021:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587026:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587031:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587036:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587040:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587045:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587061:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587065:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587069:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587073:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587077:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587082:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587086:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587091:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587095:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587100:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587105:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587110:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587115:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587120:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587125:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587130:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587135:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.587141:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588013:0:5805:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9096c70e7200:5805] 0 exiting: rc = 1 00000100:00100000:3.0:1784936759.588375:0:5806:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9096c70e6c00:5806] 1 exiting: rc = 0 00000100:00100000:1.0:1784936759.588495:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588501:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588506:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588511:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588516:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588521:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588526:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588531:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588535:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588540:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588544:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588630:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588639:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588644:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588650:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588655:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588673:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588678:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588683:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588687:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588691:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588696:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588701:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588705:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588710:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588716:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588721:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588725:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588730:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588735:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588740:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588745:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588749:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588754:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588758:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588763:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588769:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588773:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588779:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588784:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588789:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588794:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588800:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588805:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588810:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588814:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588820:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588825:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588841:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588846:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588851:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588865:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588869:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588874:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588880:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588885:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588890:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588896:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588901:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588907:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588912:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588917:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588921:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.588926:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936759.589540:0:5807:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff9096c70e7400:5807] 0 exiting: rc = 1 00000100:00100000:1.0:1784936759.589695:0:5808:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff9096c70e6a00:5808] 1 exiting: rc = 0 00000100:00100000:1.0:1784936759.589754:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589761:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589766:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589771:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589776:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589781:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589786:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589791:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589795:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589800:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589805:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589809:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589814:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589819:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589823:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589837:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589843:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589847:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589852:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589858:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589863:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589877:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589882:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589886:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589891:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589896:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589900:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589905:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589910:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589914:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589919:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589924:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589929:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589933:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589938:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589942:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589946:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589952:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589956:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589960:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589965:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589970:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589975:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589980:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589985:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589989:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589993:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.589998:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590002:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590006:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590010:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590015:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590019:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590024:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590028:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590032:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590045:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590049:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590054:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590059:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590064:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590068:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590073:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.590078:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936759.590867:0:5809:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff9096c70e7800:5809] 0 exiting: rc = 1 00000100:00100000:1.0:1784936759.591020:0:5810:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff9096c70e7c00:5810] 1 exiting: rc = 0 00000100:00100000:1.0:1784936759.591184:0:5811:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff9096c70e6400:5811] 2 exiting: rc = 0 00000100:00100000:1.0:1784936759.594594:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594607:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594614:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594620:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594626:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594631:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594637:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594642:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594648:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594681:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594688:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594694:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594699:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594704:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594709:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594714:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594720:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594725:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594731:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594737:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594742:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594750:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594755:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594760:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594767:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594791:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594798:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594804:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594809:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594814:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594819:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594824:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594840:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594861:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594868:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594875:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594881:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594887:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594893:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594897:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594904:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594910:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594916:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594921:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594927:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594933:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594939:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594946:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594952:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594959:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594966:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594971:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594977:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594984:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594989:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.594995:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595000:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595005:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595012:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595018:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595031:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595037:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595042:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936759.595048:0:12885:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784936759.606164:0:12885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784936759.606180:0:12885:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1784936759.606186:0:12885:0:(genops.c:906:class_export_put()) final put ffff9096c504e800/MDS_uuid 00000020:00000080:1.0:1784936759.606190:0:12885:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c504e800/MDS_uuid for MDS 00000020:01000000:1.0:1784936759.606196:0:12885:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1784936759.606347:0:12885:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784936759.728575:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936760.787121:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936761.802193:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784936762.157690:0:13038:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784936762.171010:0:13038:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1784936762.171063:0:13038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.171078:0:13038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.171086:0:13038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.171094:0:13038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.171123:0:13038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784936762.171129:0:13038:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784936762.171151:0:13038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784936762.171156:0:13038:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784936762.171163:0:13038:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784936762.171169:0:13038:0:(import.c:65:import_set_state_nolock()) ffff9096ff890800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1784936762.171173:0:13038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784936762.171175:0:13038:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784936762.171192:0:13038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784936762.172095:0:13038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172109:0:13038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172116:0:13038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172122:0:13038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172141:0:13038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784936762.172147:0:13038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172154:0:13038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172161:0:13038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172167:0:13038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936762.172174:0:13038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1784936762.172176:0:13038:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1784936762.172197:0:13038:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1784936762.172201:0:13038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1784936762.172205:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784936762.172219:0:13038:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784936762.172223:0:13038:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9096d0c019c0) has no exports 00000020:00080000:2.0:1784936762.172250:0:13038:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9096d0c019c0) has no exports 00010000:00010000:3.0:1784936762.173867:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784936762.173880:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.173893:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fce00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936762.173898:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.173908:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936762.173916:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936762.173936:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784936762.173939:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784936762.173943:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784936762.173984:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.173991:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936762.174018:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174025:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fce00/0x6cf7a864723f58d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58dc expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174041:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936762.174044:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174050:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18a00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936762.174053:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174060:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936762.174066:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936762.174071:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784936762.174073:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1784936762.174075:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1784936762.174097:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174103:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936762.174110:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174117:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096f4d18a00/0x6cf7a864723f58e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f58ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174126:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936762.174130:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174136:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a200 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:3.0:1784936762.174139:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174146:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784936762.174153:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936762.174158:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784936762.174160:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784936762.174162:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784936762.174172:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174177:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784936762.174191:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174204:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f5b1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6cf7a864723f5b21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936762.174213:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936762.174214:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936762.174216:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936762.174235:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524128768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936762.174306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936762.174364:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784936762.174370:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524128896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936762.174393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936762.174422:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524129024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936762.174468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936762.174510:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128768 00000100:00100000:3.0:1784936762.174517:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128768 00000100:00100000:3.0:1784936762.174548:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524128896 00000100:00100000:3.0:1784936762.174551:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524128896 00000100:00100000:3.0:1784936762.174561:0:5783:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524129024 00000100:00100000:3.0:1784936762.174563:0:5783:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524129024 00000100:00100000:3.0:1784936762.174575:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784936762.174583:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1871641524128768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784936762.174589:0:5783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784936762 with bad export cookie 7851929624710698430 00010000:00010000:0.0:1784936762.175256:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1784936762.177975:0:13038:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9096c5a7f1e0 - data ffff9096ffd79948/ffff9096d46a9c00 00000020:01000000:2.0:1784936762.178122:0:13038:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9096d013c300 - data ffff9096e5abbd80/ffff9096ff50cc00 00000100:00100000:3.0:1784936762.183250:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1871641524128768:12345-0@lo:103:ldlm_bl.0 Request processed in 8658us (8935us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784936762.183265:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1784936762.183319:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784936762.183338:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9096c5821000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784936762.183342:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784936762.191455:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.101@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784936762.191461:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784936762.191471:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9096ff426a00 x1871641524128768/t0(0) o103->MGC192.168.204.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784936778 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936762.191485:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9096ff424380 x1871641524128896/t0(0) o103->MGC192.168.204.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784936778 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936762.191493:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9096ff426680 x1871641524129024/t0(0) o103->MGC192.168.204.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784936778 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784936762.191507:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784936762.191509:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784936762.191511:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784936762.191514:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9096c5821000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784936762.191519:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 194 00000100:00080000:3.0:1784936762.191528:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import ffff9096c5821000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936762.191562:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff427480 x1871641524129152/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784936762.191608:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b62e4f62-8046-4b06-8586-527734139351:3304:1871641524129152:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1784936762.191654:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871641524129152 offset 0 length 520: 4 00000100:00100000:3.0:1784936762.191711:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524128896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936762.191717:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b62e4f62-8046-4b06-8586-527734139351:3307:1871641524128768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936762.191752:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784936762.191760:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1871641524128896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784936762.191767:0:5783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784936762 with bad export cookie 7851929624710698430 00000400:00000100:3.0:1784936762.191827:0:5783:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1871641524128896 offset 224 length 224: 4 00000100:00100000:3.0:1784936762.191837:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1871641524128896:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (17444us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784936762.191845:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784936762.191866:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784936762.191870:0:5783:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1871641524129024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784936762.191875:0:5783:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784936762 with bad export cookie 7851929624710698430 00000100:00100000:3.0:1784936762.191906:0:5783:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1871641524129024:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (17437us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784936762.191912:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784936762.192073:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b62e4f62-8046-4b06-8586-527734139351:3305:1871641524129024:0@lo:103:ldlm_bl.0 00100000:10000000:2.0:1784936762.211325:0:13038:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784936762.240850:0:13038:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f56f2 00000020:00000080:0.0:1784936762.240860:0:13038:0:(genops.c:906:class_export_put()) final put ffff9096d0015800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1784936762.240980:0:13038:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096f4d33000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1784936762.240985:0:13038:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096f4d33000 2 00000020:01000004:0.0:1784936762.240989:0:13038:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9096f4d33000 from lustre-OST0000 00000020:00000080:0.0:1784936762.241019:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936762.241030:0:13038:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1784936762.241033:0:13038:0:(genops.c:906:class_export_put()) final put ffff9096d0015000/lustre-OST0000_UUID 00000020:00000080:0.0:1784936762.241037:0:13038:0:(genops.c:865:class_export_destroy()) destroying export ffff9096d0015000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1784936762.241044:0:13038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1784936762.241093:0:13038:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1784936762.241098:0:13038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1784936762.241101:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936762.241106:0:13038:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784936762.241114:0:13038:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9096ff891000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784936762.241120:0:13038:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9096ff884d40) has exports, disconnecting them 00000020:00080000:0.0:1784936762.241125:0:13038:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9096ff891000), last request at 1784936546 00000020:00000080:0.0:1784936762.241128:0:13038:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f571c 00000020:00080000:0.0:1784936762.241137:0:13038:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9096ff891000): rc 0 00000020:00000080:0.0:1784936762.241143:0:13038:0:(genops.c:906:class_export_put()) final put ffff9096ff891000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784936762.241226:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096d0015800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784936762.242386:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ff891000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784936762.273425:0:13038:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784936762.273455:0:13038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784936762.273459:0:13038:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784936762.273478:0:13038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784936762.274357:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ff890800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784936762.274386:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936762.274397:0:13038:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784936762.274404:0:13038:0:(genops.c:906:class_export_put()) final put ffff9096f4d32800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784936762.274408:0:13038:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4d32800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784936762.274416:0:13038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1784936762.274497:0:13038:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096f4d33000 1 00000020:00000080:0.0:1784936762.274505:0:13038:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f56ac 00000020:00000080:0.0:1784936762.274512:0:13038:0:(genops.c:906:class_export_put()) final put ffff9096c83ac800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784936762.274521:0:13038:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784936762.274526:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936762.274530:0:13038:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784936762.274534:0:13038:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9096fb8d8000) has no exports 00000020:00000080:3.0:1784936762.275092:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c83ac800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000001:00100000:2.0:1784936762.294665:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784936762.294678:0:7508:0:(genops.c:906:class_export_put()) final put ffff9096ef1e8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784936762.294711:0:11837:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784936762.295030:0:11837:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1ee000 for lustre-OST0001 00000020:00000080:2.0:1784936762.316899:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784936762.316933:0:13038:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1784936762.316940:0:13038:0:(genops.c:906:class_export_put()) final put ffff9096f4d32000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1784936762.316945:0:13038:0:(genops.c:865:class_export_destroy()) destroying export ffff9096f4d32000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1784936762.316961:0:13038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1784936762.317162:0:13038:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9096f4d30800 00000020:02000400:2.0:1784936762.317235:0:13038:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1784936762.765474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b62e4f62-8046-4b06-8586-527734139351->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784936762.765489:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b62e4f62-8046-4b06-8586-527734139351->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784936762.765494:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784936762.765498:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784936762.765504:0:36:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784936762.765515:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 423 00000100:00080000:3.0:1784936762.765523:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784936762.765532:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9096ef1eb000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936762.765599:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff426a00 x1871641524129280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936762.765821:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524129280:0@lo:38:kworker.0 00000400:00000100:0.0:1784936762.765897:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871641524129280 offset 0 length 520: 4 00010000:00010000:1.0:1784936762.825580:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936763.848769:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936764.873633:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784936764.984376:0:13189:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784936765.000040:0:13189:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1784936765.000118:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936765.000134:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936765.000141:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936765.000148:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936765.000189:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784936765.000196:0:13189:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784936765.000219:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784936765.000230:0:13189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9096ff426a00 x1871641524129280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784936777 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936765.000244:0:13189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784936765.000250:0:13189:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784936765.000256:0:13189:0:(import.c:65:import_set_state_nolock()) ffff9096ef1eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1784936765.000261:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784936765.000265:0:13189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9096ff426a00 x1871641524129280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784936777 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936765.000272:0:13189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784936765.000275:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:0.0:1784936765.000608:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936765.000616:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.000624:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c13fd000 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936765.000628:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.000636:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936765.000644:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936765.000663:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784936765.000665:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784936765.000667:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784936765.000681:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9096c5821000 00010000:00010000:0.0:1784936765.000685:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.000692:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c13fd000/0x6cf7a864723f58b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f58c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.000704:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936765.000706:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936765.000708:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936765.000745:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524129280:0@lo:38:kworker.0 00010000:00010000:3.0:1784936765.003850:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.003945:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.003954:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.003962:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.003988:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936765.003996:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.004003:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.004010:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.004016:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936765.004064:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1784936765.004069:0:13189:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1784936765.004094:0:13189:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1784936765.004098:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1784936765.004102:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784936765.004107:0:13189:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784936765.004123:0:13189:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9096fb8dcd40) has no exports 00000020:00080000:3.0:1784936765.004148:0:13189:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9096fb8dcd40) has no exports 00000020:01000000:3.0:1784936765.006360:0:13189:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9096c5a7fae0 - data ffff9096ffd79000/ffff9096d46abc00 00000020:01000000:3.0:1784936765.006530:0:13189:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9096e8d22840 - data ffff9096ffc6c948/ffff9096d46aac00 00010000:00010000:0.0:1784936765.007553:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784936765.007564:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007575:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c0031200 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936765.007579:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007588:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936765.007595:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936765.007600:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784936765.007619:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1784936765.007622:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1784936765.007639:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9096c5821000 00010000:00010000:0.0:1784936765.007643:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007650:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031200/0x6cf7a864723f58c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f58ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007662:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936765.007665:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007671:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b200 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936765.007674:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007681:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936765.007687:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936765.007692:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784936765.007695:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784936765.007697:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784936765.007701:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9096c5821000 00010000:00010000:0.0:1784936765.007704:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007711:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096ee26b200/0x6cf7a864723f5b0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f5b13 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.007739:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936765.007741:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936765.007743:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936765.007983:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1784936765.024176:0:13189:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784936765.059851:0:13189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f57bd 00000020:00000080:0.0:1784936765.059862:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096edf28800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1784936765.059959:0:13189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096ffa3c000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1784936765.059964:0:13189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096ffa3c000 2 00000020:01000004:0.0:1784936765.059967:0:13189:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9096ffa3c000 from lustre-OST0001 00000020:00000080:0.0:1784936765.059990:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936765.060000:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1784936765.060003:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096edf2a000/lustre-OST0001_UUID 00000020:00000080:0.0:1784936765.060006:0:13189:0:(genops.c:865:class_export_destroy()) destroying export ffff9096edf2a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1784936765.060014:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1784936765.060199:0:13189:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b62e4f62-8046-4b06-8586-527734139351->MGS 00010000:00010000:0.0:1784936765.060215:0:13189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936765.060226:0:13189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936765.060232:0:13189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1784936765.060235:0:13189:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1784936765.060238:0:13189:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1784936765.060252:0:13189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9096c5821000 00010000:00010000:0.0:1784936765.060256:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c0031600/0x6cf7a864723f56cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f56d6 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936765.060271:0:13189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936765.060292:0:13189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936765.060297:0:13189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784936765.060300:0:13189:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1784936765.060301:0:13189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1784936765.060311:0:13189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9096c5821000 00010000:00010000:0.0:1784936765.060314:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5e00/0x6cf7a864723f590d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6cf7a864723f5914 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784936765.060330:0:13189:0:(import.c:65:import_set_state_nolock()) ffff9096c5821000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1784936765.060334:0:13189:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784936765.060336:0:13189:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784936765.060338:0:13189:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784936765.060341:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784936765.060352:0:13189:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9096ff427480 x1871641524129152/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784936772 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1784936765.060451:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096edf28800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1784936765.060505:0:13189:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784936765.060508:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1784936765.060753:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b62e4f62-8046-4b06-8586-527734139351:3304:1871641524129152:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1784936765.060973:0:13189:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784936765.060981:0:13189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f55b0 00000020:00000080:0.0:1784936765.060985:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096c504d800/b62e4f62-8046-4b06-8586-527734139351 00000020:01000000:0.0:1784936765.060998:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.101@tcp (flags='') 00000020:00000080:0.0:1784936765.061003:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936765.061008:0:13189:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784936765.061012:0:13189:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9096c8a88000) has no exports 10000000:01000000:0.0:1784936765.061030:0:5793:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1784936765.061080:0:13189:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.101@tcp: client import never connected 00000100:00080000:0.0:1784936765.061082:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1784936765.061085:0:13189:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784936765.061092:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1784936765.061094:0:13189:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784936765.061138:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784936765.061143:0:13189:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.101@tcp (uuid b62e4f62-8046-4b06-8586-527734139351) 00000020:01000000:0.0:1784936765.061148:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784936765.061152:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784936765.061155:0:13189:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784936765.061159:0:13189:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9096edf28000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784936765.061165:0:13189:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9096ff883380) has exports, disconnecting them 00000020:00080000:0.0:1784936765.061169:0:13189:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9096edf28000), last request at 1784936565 00000020:00000080:0.0:1784936765.061174:0:13189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f57e7 00000020:00080000:0.0:1784936765.061185:0:13189:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9096edf28000): rc 0 00000020:00000080:0.0:1784936765.061189:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096edf28000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784936765.061849:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c504d800/b62e4f62-8046-4b06-8586-527734139351 for MGC192.168.204.101@tcp 00000020:00000080:2.0:1784936765.061858:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096edf28000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784936765.062999:0:13189:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784936765.063006:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784936765.063010:0:13189:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784936765.063016:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784936765.063040:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096ef1eb000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784936765.063187:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784936765.063194:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1784936765.063199:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096ef1ec800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1784936765.063201:0:13189:0:(genops.c:865:class_export_destroy()) destroying export ffff9096ef1ec800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1784936765.063207:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1784936765.063270:0:13189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096ffa3c000 1 00000020:00000080:2.0:1784936765.063276:0:13189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x6cf7a864723f578c 00000020:00000080:2.0:1784936765.063282:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096efe92000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1784936765.063290:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1784936765.063299:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096efe92000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1784936765.063309:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784936765.063314:0:13189:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784936765.063317:0:13189:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9096d0c03380) has no exports 00000020:00000080:2.0:1784936765.067977:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9096c5821000 for MGC192.168.204.101@tcp 00000020:00000080:2.0:1784936765.067994:0:36:0:(genops.c:906:class_export_put()) final put ffff9096c5825000/b62e4f62-8046-4b06-8586-527734139351 00000020:00000080:2.0:1784936765.067998:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c5825000/b62e4f62-8046-4b06-8586-527734139351 for MGC192.168.204.101@tcp 00000020:01000000:2.0:1784936765.068005:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.101@tcp (b62e4f62-8046-4b06-8586-527734139351) 00010000:00010000:2.0:1784936765.068287:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1784936765.068639:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1784936765.071028:0:5779:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9096e8f5b800:5779] 0 exiting: rc = 1 00000100:00100000:3.0:1784936765.072641:0:5780:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9096d47a0c00:5780] 1 exiting: rc = 0 00000100:00100000:3.0:1784936765.072749:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073004:0:5782:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9096c5ade000:5782] 1 exiting: rc = 0 00000100:00100000:3.0:1784936765.073063:0:5781:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9096c581f600:5781] 0 exiting: rc = 1 00000100:00100000:3.0:1784936765.073127:0:5783:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9096e5cb7200:5783] 2 exiting: rc = 0 00000100:00100000:3.0:1784936765.073176:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073184:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073190:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073197:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073205:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073210:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073224:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073232:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073238:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073244:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073249:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073257:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073262:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073266:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073272:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073277:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073283:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073288:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073293:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073298:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073303:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073322:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073327:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073332:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073336:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073341:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073346:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073351:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073357:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073362:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073368:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073373:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073378:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073382:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073388:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073393:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073397:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073402:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073406:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073411:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073417:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073423:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073450:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073456:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073461:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073466:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073471:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073476:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073481:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073486:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073493:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073498:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073503:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073508:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073513:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073519:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073532:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073538:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073543:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073547:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073552:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073557:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073562:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.073568:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784936765.101318:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784936765.101337:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1784936765.101343:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096c5532000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1784936765.101349:0:13189:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c5532000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1784936765.101464:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1784936765.102350:0:13189:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9096ffa3d000 00000020:01000000:3.0:1784936765.102377:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1784936765.102381:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784936765.102386:0:13189:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784936765.102391:0:13189:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9096c8a899c0) has no exports 00000020:00000080:3.0:1784936765.102425:0:13189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784936765.102450:0:13189:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1784936765.102454:0:13189:0:(genops.c:906:class_export_put()) final put ffff9096c83ab800/OSS_uuid 00000020:00000080:3.0:1784936765.102457:0:13189:0:(genops.c:865:class_export_destroy()) destroying export ffff9096c83ab800/OSS_uuid for OSS 00000020:01000000:3.0:1784936765.102461:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1784936765.102566:0:5792:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1784936765.102750:0:8072:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff9096ff345800:8072] 3 exiting: rc = 0 00000100:00100000:0.0:1784936765.102822:0:6595:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff9096c5957c00:6595] 0 exiting: rc = 1 00000100:00100000:0.0:1784936765.102894:0:6597:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff9096fb2ca200:6597] 1 exiting: rc = 0 00000100:00100000:3.0:1784936765.105399:0:6598:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff9096edc44400:6598] 2 exiting: rc = 0 00000100:00100000:0.0:1784936765.105516:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105530:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105541:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105549:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105555:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105560:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105566:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105572:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105578:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105584:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105589:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105595:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105600:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105622:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105628:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105647:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105652:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105657:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105663:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105668:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105673:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105679:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105683:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105689:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105694:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105700:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105708:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105714:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105720:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105735:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105740:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105746:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105751:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105758:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105764:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105769:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105774:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105779:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105786:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105791:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105795:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105801:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105806:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105811:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105817:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105824:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105829:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105835:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105840:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105847:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105860:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105876:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105882:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105887:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105892:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105897:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.105902:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106101:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106112:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106119:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106124:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106129:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106134:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.106139:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936765.108021:0:6599:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9096fb2cac00:6599] 0 exiting: rc = 1 00000100:00100000:3.0:1784936765.109707:0:6600:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9096fb2cb600:6600] 1 exiting: rc = 0 00000100:00100000:3.0:1784936765.110533:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110553:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110559:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110563:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110568:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110573:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110578:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110582:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110587:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110602:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110613:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110619:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110624:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110628:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110633:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110637:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110641:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110646:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110650:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110655:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110659:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110663:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110668:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110672:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110676:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110680:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110684:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110689:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110693:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110702:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110707:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110711:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110715:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110720:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110734:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110738:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110742:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110747:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110752:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110756:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110760:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110765:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110769:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110780:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110790:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110795:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110799:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110804:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110809:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110814:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110821:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110826:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110830:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110834:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110839:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110843:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110847:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110852:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110856:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110861:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110866:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110869:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110873:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.110878:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784936765.113039:0:6602:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9096fb2cbc00:6602] 1 exiting: rc = 0 00000100:00100000:0.0:1784936765.113186:0:6601:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9096edc45600:6601] 0 exiting: rc = 1 00000100:00100000:1.0:1784936765.113247:0:6603:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9096fb2ca400:6603] 2 exiting: rc = 0 00000100:00100000:3.0:1784936765.113551:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113561:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113571:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113579:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113589:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113609:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113628:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113637:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113648:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113659:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113668:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113674:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113680:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113685:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113690:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113709:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113714:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113720:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113738:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113743:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113749:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113754:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113760:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113766:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113771:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113777:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113783:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113788:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113794:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113799:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113820:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113833:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113838:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113843:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113848:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113853:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113857:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113863:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113870:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113876:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113881:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113891:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113898:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113904:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113909:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113988:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.113995:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114001:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114007:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114012:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114026:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114031:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114037:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114044:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114050:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114055:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114061:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114066:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114091:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114098:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114104:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114109:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114115:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.114121:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.120419:0:6605:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9096edc44000:6605] 1 exiting: rc = 0 00000100:00100000:1.0:1784936765.121290:0:6604:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9096edc44a00:6604] 0 exiting: rc = 1 00000100:00100000:3.0:1784936765.121412:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121420:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121443:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121450:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121455:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121461:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121466:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121473:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121479:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121484:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121490:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121495:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121500:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121505:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121510:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121515:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121521:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121526:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121532:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121538:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121543:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121563:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121569:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121574:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121580:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121585:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121589:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121594:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121599:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121604:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121609:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121613:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121618:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121622:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121627:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121631:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121636:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121640:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121645:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121649:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121653:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121657:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121662:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121665:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121669:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121674:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121678:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121682:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121687:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121691:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121695:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121699:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121704:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121708:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121713:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121717:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121737:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121742:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121747:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121752:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121757:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121762:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121766:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.121772:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784936765.123617:0:6607:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff909700462600:6607] 1 exiting: rc = 0 00000100:00100000:2.0:1784936765.123662:0:6606:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff909700462400:6606] 0 exiting: rc = 1 00000100:00100000:3.0:1784936765.123773:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123780:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123794:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123814:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123822:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123828:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123835:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123843:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123849:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123855:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123861:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123867:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123872:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.123877:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124015:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124038:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124045:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124051:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124057:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124063:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124069:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124074:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124082:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124088:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124093:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124100:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124106:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124138:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124145:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124151:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124157:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124162:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124167:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124172:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124178:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124184:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124190:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124196:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124201:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124223:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124229:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124235:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124242:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124247:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124253:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124258:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124263:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124269:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124275:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124280:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124287:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124309:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124316:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124322:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124328:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124334:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124340:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124346:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124351:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124357:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124362:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124379:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124394:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784936765.124413:0:13189:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1784936765.133083:0:13189:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1784936780.322016:0:13803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784936787.334597:0:14215:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784936787.334603:0:14215:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784936787.334794:0:14215:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9096ff4ed800 00000020:01000004:3.0:1784936787.334812:0:14215:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784936787.334820:0:14215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784936787.334834:0:14215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9096d0c03380) 00000020:00000080:3.0:1784936787.334846:0:14215:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784936787.355850:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784936787.359269:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1784936787.360845:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784936787.360920:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 83: rc = 0 00100000:10000000:2.0:1784936787.361586:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 83: rc = 0 00100000:10000000:2.0:1784936787.362229:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 83: rc = 0 00100000:10000000:2.0:1784936787.362347:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 83: rc = 0 00100000:10000000:2.0:1784936787.363154:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 83: rc = 0 00100000:10000000:2.0:1784936787.363263:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 83: rc = 0 00100000:10000000:2.0:1784936787.364413:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 85: rc = 0 00100000:10000000:2.0:1784936787.367778:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 647: rc = 0 00100000:10000000:2.0:1784936787.367879:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 647: rc = 0 00100000:10000000:2.0:1784936787.369212:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 119: rc = 0 00100000:10000000:2.0:1784936787.369797:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 119: rc = 0 00100000:10000000:2.0:1784936787.370178:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 119: rc = 0 00100000:10000000:3.0:1784936787.371132:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 119: rc = 0 00100000:10000000:3.0:1784936787.371421:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 119: rc = 0 00100000:10000000:3.0:1784936787.371726:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 119: rc = 0 00100000:10000000:3.0:1784936787.371990:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 119: rc = 0 00100000:10000000:3.0:1784936787.372956:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 119: rc = 0 00100000:10000000:3.0:1784936787.374336:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 119: rc = 0 00100000:10000000:3.0:1784936787.374954:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 119: rc = 0 00100000:10000000:3.0:1784936787.375595:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 119: rc = 0 00100000:10000000:3.0:1784936787.375970:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 119: rc = 0 00100000:10000000:3.0:1784936787.376828:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 775: rc = 0 00100000:10000000:3.0:1784936787.377290:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 775: rc = 0 00100000:10000000:3.0:1784936787.377863:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 775: rc = 0 00100000:10000000:3.0:1784936787.378278:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 775: rc = 0 00100000:10000000:3.0:1784936787.378567:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 775: rc = 0 00100000:10000000:3.0:1784936787.378907:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 775: rc = 0 00100000:10000000:3.0:1784936787.379309:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 775: rc = 0 00100000:10000000:3.0:1784936787.379682:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 775: rc = 0 00100000:10000000:3.0:1784936787.379935:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 775: rc = 0 00100000:10000000:3.0:1784936787.380406:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 775: rc = 0 00100000:10000000:3.0:1784936787.380809:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 775: rc = 0 00100000:10000000:3.0:1784936787.381198:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 775: rc = 0 00100000:10000000:3.0:1784936787.381537:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 775: rc = 0 00100000:10000000:3.0:1784936787.381809:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 775: rc = 0 00100000:10000000:3.0:1784936787.382249:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 775: rc = 0 00100000:10000000:3.0:1784936787.382540:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 775: rc = 0 00100000:10000000:3.0:1784936787.382874:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 775: rc = 0 00100000:10000000:3.0:1784936787.383558:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 775: rc = 0 00100000:10000000:3.0:1784936787.383879:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 775: rc = 0 00100000:10000000:3.0:1784936787.384265:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 775: rc = 0 00100000:10000000:3.0:1784936787.384716:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 775: rc = 0 00100000:10000000:3.0:1784936787.385395:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 775: rc = 0 00100000:10000000:3.0:1784936787.385792:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 775: rc = 0 00100000:10000000:3.0:1784936787.386166:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 775: rc = 0 00100000:10000000:3.0:1784936787.386449:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 775: rc = 0 00100000:10000000:3.0:1784936787.386722:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 775: rc = 0 00100000:10000000:3.0:1784936787.386969:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 775: rc = 0 00100000:10000000:3.0:1784936787.387544:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 775: rc = 0 00100000:10000000:3.0:1784936787.387896:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 775: rc = 0 00100000:10000000:3.0:1784936787.388292:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 775: rc = 0 00100000:10000000:3.0:1784936787.388699:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 775: rc = 0 00100000:10000000:3.0:1784936787.388954:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 775: rc = 0 00100000:10000000:3.0:1784936787.389574:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 657: rc = 0 00100000:10000000:3.0:1784936787.390339:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1784936787.390545:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 545: rc = 0 00100000:10000000:3.0:1784936787.390758:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1784936787.390838:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 545: rc = 0 00100000:10000000:3.0:1784936787.391054:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1784936787.391141:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 545: rc = 0 00100000:10000000:3.0:1784936787.391931:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1784936787.392139:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:3.0:1784936787.392356:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1784936787.392515:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:3.0:1784936787.392779:0:14215:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1784936787.392854:0:14215:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00000020:00000080:3.0:1784936787.393288:0:14215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784936787.393309:0:14215:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784936787.393322:0:14215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f68b1 00000020:01000004:3.0:1784936787.393333:0:14215:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784936787.393339:0:14215:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784936787.393346:0:14215:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9096ff4ed800 from MGS 00000020:01000004:3.0:1784936787.393351:0:14215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784936787.393361:0:14215:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9096d0c04d40) 00000020:00000080:3.0:1784936787.393373:0:14215:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784936787.393517:0:14215:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096ff4ed800 from MGS, refs=2 00080000:01000000:3.0:1784936787.393523:0:14215:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784936787.393529:0:14215:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f68bf 00000100:00100000:3.0:1784936787.393709:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784936787.393831:0:14215:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784936787.393837:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784936787.394418:0:14215:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784936787.394548:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784936787.395377:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.395733:0:14215:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784936787.395738:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784936787.396329:0:14215:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784936787.396336:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784936787.396830:0:14215:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784936787.396837:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784936787.397632:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936787.397635:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936787.397637:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936787.398102:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936787.398105:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936787.398107:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936787.398765:0:14215:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784936787.406261:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784936787.410784:0:14215:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1784936787.410801:0:14215:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784936787.410804:0:14215:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784936787.412374:0:14224:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784936787.412553:0:14215:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784936787.412657:0:14215:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784936787.413238:0:14215:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784936787.413598:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.413748:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784936787.413754:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784936787.414463:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784936787.414471:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784936787.414785:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784936787.414791:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784936787.415644:0:14215:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784936787.415665:0:14215:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.101@tcp' 00000020:01000004:3.0:1784936787.415666:0:14215:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784936787.415696:0:14215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.101@tcp (typ=mgc) 00000020:00000080:3.0:1784936787.415708:0:14215:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.101@tcp (ffff9096d0c00000) 00000020:00000080:3.0:1784936787.415722:0:14215:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784936787.415794:0:14215:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096c504e800@MGC192.168.204.101@tcp: add connection 192.168.204.101@tcp at head 00010000:00010000:3.0:1784936787.415924:0:14215:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.101@tcp-0 is initialized 00000040:01000000:3.0:1784936787.415931:0:14215:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 1 is initialized 00000100:00080000:2.0:1784936787.416052:0:14228:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784936787.424157:0:14230:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784936787.425655:0:14215:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.101@tcp (uuid 8567782c-cd42-40bd-85ed-bd4db0d07a3f) 00000020:00000080:3.0:1784936787.425683:0:14215:0:(genops.c:1406:class_connect()) connect: client 8567782c-cd42-40bd-85ed-bd4db0d07a3f, cookie 0x6cf7a864723f68cd 00000100:00080000:3.0:1784936787.425695:0:14215:0:(import.c:510:import_select_connection()) MGC192.168.204.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784936787.425702:0:14215:0:(import.c:624:import_select_connection()) MGC192.168.204.101@tcp: import ffff9096c504e800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936787.425736:0:14215:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff427b80 x1871641524129408/t0(0) o250->MGC192.168.204.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936787.425800:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3304:1871641524129408:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784936787.425866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784936787.425916:0:14215:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8567782c-cd42-40bd-85ed-bd4db0d07a3f->MGS 00000020:01000004:3.0:1784936787.425940:0:14215:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784936787.425945:0:14215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784936787.425959:0:14215:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9096d0c019c0) 00000020:00000080:3.0:1784936787.425977:0:14215:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784936787.433199:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524129408 00000100:00100000:1.0:1784936787.433214:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524129408 00000100:00100000:1.0:1784936787.433318:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936787.433331:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1871641524129408:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784936787.433370:0:14225:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8567782c-cd42-40bd-85ed-bd4db0d07a3f@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1784936787.433408:0:14225:0:(genops.c:1406:class_connect()) connect: client 8567782c-cd42-40bd-85ed-bd4db0d07a3f, cookie 0x6cf7a864723f68db 00000100:00080000:1.0:1784936787.433599:0:14225:0:(import.c:65:import_set_state_nolock()) ffff9096cb3ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936787.433724:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+5:3304:x1871641524129408:12345-0@lo:250:mount.lustre.0 Request processed in 392us (7855us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936787.433732:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936787.433791:0:3304:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784936787.433805:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.101@tcp: connect to target with instance 0 00000100:00080000:0.0:1784936787.433815:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784936787.433822:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784936787.433826:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096c504e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784936787.433829:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784936787.433842:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784936787.433848:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3304:1871641524129408:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784936787.437614:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.437805:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784936787.437811:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784936787.438675:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784936787.438683:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1784936787.439579:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1784936787.439588:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784936787.440339:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.440679:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784936787.440685:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784936787.441164:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784936787.441170:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784936787.497858:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.498212:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784936787.498219:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784936787.499416:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784936787.499560:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784936787.500350:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.500637:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784936787.500643:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784936787.501279:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784936787.501285:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784936787.502195:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.502365:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784936787.502372:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784936787.502908:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784936787.502915:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784936787.503849:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.504141:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784936787.504147:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784936787.504780:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784936787.504787:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784936787.525194:0:14215:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936787.526276:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784936787.526284:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784936787.529566:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784936787.529583:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784936787.530537:0:14215:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784936787.530622:0:14215:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784936787.531618:0:14215:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784936787.531643:0:14215:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784936787.531649:0:14215:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784936787.531792:0:14215:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784936787.531830:0:14215:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784936787.531835:0:14215:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784936787.531836:0:14215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784936787.531838:0:14215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936787.531839:0:14215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936787.531840:0:14215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936787.531841:0:14215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936787.531843:0:14215:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784936787.531844:0:14215:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784936787.531846:0:14215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936787.531848:0:14215:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936787.531850:0:14215:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784936787.531852:0:14215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784936787.531853:0:14215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784936787.531855:0:14215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936787.531856:0:14215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936787.531857:0:14215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936787.531858:0:14215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936787.531859:0:14215:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784936787.531860:0:14215:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784936787.531861:0:14215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936787.531862:0:14215:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936787.531893:0:14215:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784936787.531911:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784936787.531999:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936787.532160:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c526f480 going to sleep for 11 seconds 00000100:00100000:3.0:1784936787.532216:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524129536 00000100:00100000:3.0:1784936787.532224:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524129536 00000100:00100000:3.0:1784936787.532312:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936787.532321:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+5:14215:x1871641524129536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784936787.532372:0:14227:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784936787.532375:0:14227:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784936787.532378:0:14227:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784936787.532692:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784936787.533171:0:14227:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1784936787.534686:0:14249:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784936787.534694:0:14249:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784936787.534697:0:14249:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784936787.534732:0:14249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1784936787.535030:0:14227:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784936787.535040:0:14227:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784936787.549139:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+5:14215:x1871641524129536:12345-0@lo:253:mount.lustre.0 Request processed in 16809us (17130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936787.549160:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936787.549333:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784936787.549349:0:14215:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784936787.549353:0:14215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784936787.549368:0:14215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784936787.549369:0:14215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936787.549371:0:14215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936787.549372:0:14215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936787.549373:0:14215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936787.549374:0:14215:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784936787.549376:0:14215:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784936787.549377:0:14215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936787.549378:0:14215:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784936787.549398:0:14215:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9096ff4ed800 from lustre-MDT0000 10000000:01000000:0.0:1784936787.549422:0:14215:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784936787.549425:0:14215:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784936787.549458:0:14215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9096d0c00000 10000000:01000000:0.0:1784936787.549463:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784936787.549471:0:14215:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9096d0c00000 from 1 10000000:01000000:0.0:1784936787.549474:0:14215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784936787.549514:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.549526:0:14215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.549536:0:14215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.549555:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784936787.549590:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.549622:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d01b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936787.549717:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524129664 00000100:00100000:1.0:1784936787.549724:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524129664 00000100:00100000:1.0:1784936787.549775:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784936787.549784:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+5:14215:x1871641524129664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784936787.549797:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936787.549812:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8164600/0x6cf7a864723f68e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f68e2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.549837:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164600/0x6cf7a864723f68e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f68e2 expref: 6 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.549847:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8164600/0x6cf7a864723f68e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f68e2 expref: 6 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.549857:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164600, rc 0) 00000100:00100000:1.0:1784936787.549888:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+6:14215:x1871641524129664:12345-0@lo:101:mount.lustre.0 Request processed in 106us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936787.549895:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936787.550793:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.550812:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.550824:0:14215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.550896:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.550930:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.551009:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d01b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936787.559320:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524129792 00000100:00100000:2.0:1784936787.559340:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524129792 00000100:00100000:2.0:1784936787.559459:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936787.559470:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+6:14215:x1871641524129792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936787.559785:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+6:14215:x1871641524129792:12345-0@lo:501:mount.lustre.0 Request processed in 317us (8854us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784936787.559794:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936787.560007:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129792:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784936787.560062:0:14215:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784936787.560083:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936787.560095:0:14215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936787.560105:0:14215:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9096ff4ed800 10000000:01000000:3.0:1784936787.560111:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784936787.560115:0:14215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9096ff4ed800 10000000:01000000:3.0:1784936787.560118:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784936787.560122:0:14215:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9096ff4ed800 from 1 10000000:01000000:3.0:1784936787.560124:0:14215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784936787.560166:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936787.560175:0:14215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936787.560195:0:14215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936787.560217:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784936787.560259:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936787.560308:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4608f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936787.560462:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524129920 00000100:00100000:2.0:1784936787.560468:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524129920 00000100:00100000:2.0:1784936787.560502:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784936787.560510:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+6:14215:x1871641524129920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784936787.560521:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936787.560538:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f68f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f68f0 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.560560:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f68f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f68f0 expref: 7 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.560569:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f4d18e00/0x6cf7a864723f68f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f68f0 expref: 7 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.560578:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f4d18e00, rc 0) 00000100:00100000:2.0:1784936787.560627:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+7:14215:x1871641524129920:12345-0@lo:101:mount.lustre.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936787.560634:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784936787.560714:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524129920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.560728:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68f7 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560737:0:14215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f68f7 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936787.560750:0:14215:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784936787.560765:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68f7 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560773:0:14215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5800/0x6cf7a864723f68f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68f7 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936787.560780:0:14215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784936787.560783:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784936787.560788:0:14215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9096ff4ed800 10000000:01000000:0.0:1784936787.560791:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784936787.560793:0:14215:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784936787.560796:0:14215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784936787.560810:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560817:0:14215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560831:0:14215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.560844:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784936787.560872:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.560901:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524130048 00000100:00100000:0.0:1784936787.560905:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524130048 00000100:00100000:0.0:1784936787.560929:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936787.560934:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+7:14215:x1871641524130048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.560941:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936787.560951:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26b000/0x6cf7a864723f6905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f68fe expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560965:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26b000/0x6cf7a864723f6905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f68fe expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560973:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26b000/0x6cf7a864723f6905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f68fe expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.560980:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b000, rc 0) 00000100:00100000:0.0:1784936787.561004:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+8:14215:x1871641524130048:12345-0@lo:101:mount.lustre.0 Request processed in 69us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.561009:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936787.561038:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d01b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.561067:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.561076:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6905 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.561089:0:14215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6905 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.561130:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.561155:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.561174:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524130176 00000100:00100000:0.0:1784936787.561178:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524130176 00000100:00100000:0.0:1784936787.561196:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936787.561200:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+8:14215:x1871641524130176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.561616:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14215:x1871641524130176:12345-0@lo:501:mount.lustre.0 Request processed in 414us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.561624:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936787.561649:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d01b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.561661:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.561691:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936787.561730:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.561751:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524130304 00000100:00100000:0.0:1784936787.561755:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524130304 00000100:00100000:0.0:1784936787.561774:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784936787.561780:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14215:x1871641524130304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936787.562054:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14215:x1871641524130304:12345-0@lo:503:mount.lustre.0 Request processed in 273us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.562061:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784936787.562094:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d01b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.562113:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784936787.569233:0:14250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14250:1871641524130432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936787.569333:0:14250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936787.569369:0:14250:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d4608e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.569471:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524130432 00000100:00100000:0.0:1784936787.569480:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524130432 00000100:00100000:0.0:1784936787.569529:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784936787.569538:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14250:x1871641524130432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936787.570168:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14250:x1871641524130432:12345-0@lo:502:llog_process_th.0 Request processed in 628us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.570177:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936787.570289:0:14250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14250:1871641524130432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936787.570330:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936787.570341:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.570343:0:14250:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784936787.570349:0:14250:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784936787.570353:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784936787.570381:0:14250:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9097019b0000) 00000020:00000080:3.0:1784936787.570401:0:14250:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1784936787.570408:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784936787.570518:0:14250:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784936787.570527:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f6913 00000020:00000080:3.0:1784936787.570746:0:14250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784936787.570750:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936787.570753:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.570755:0:14250:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784936787.570757:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936787.570760:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.570762:0:14250:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784936787.570765:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784936787.570776:0:14250:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9097019b4d40) 00000020:00000080:3.0:1784936787.570785:0:14250:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784936787.570789:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784936787.570791:0:14250:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784936787.570794:0:14250:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784936787.570799:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784936787.570844:0:14250:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096ff4ed800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784936787.570856:0:14250:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9097019b19c0) 00000020:00000080:3.0:1784936787.570864:0:14250:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784936787.570915:0:14250:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784936787.570921:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f6928 00000020:00000080:3.0:1784936787.570998:0:14250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784936787.571004:0:14250:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784936787.571009:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6cf7a864723f692f 00080000:01000000:3.0:1784936787.571013:0:14250:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784936787.571016:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f6936 00010000:00010000:3.0:1784936787.654385:0:14250:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1784936787.654972:0:14250:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1784936787.655158:0:14250:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784936787.655760:0:14250:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9097019b3380) 00000020:00000080:3.0:1784936787.655779:0:14250:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784936787.655848:0:14250:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784936787.655855:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f6944 00000020:00000080:3.0:1784936787.656358:0:14250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784936787.660804:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6cf7a864723f694b 00000020:00000080:0.0:1784936787.661361:0:14250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784936787.661373:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936787.661380:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.661382:0:14250:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784936787.661386:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784936787.661536:0:14250:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1784936787.661539:0:14250:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784936787.661541:0:14250:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784936787.661543:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784936787.661547:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.661548:0:14250:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784936787.661552:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936787.661556:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.661557:0:14250:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784936787.661562:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784936787.661679:0:14250:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784936787.661696:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936787.661699:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.661700:0:14250:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784936787.661703:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784936787.661707:0:14250:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784936787.661710:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.661711:0:14250:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784936787.661721:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784936787.661726:0:14250:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:0.0:1784936787.661753:0:14250:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784936787.661756:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784936787.661770:0:14250:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9096fb8dcd40) 00000020:00000080:0.0:1784936787.661784:0:14250:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1784936787.661790:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784936787.661845:0:14250:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784936787.661851:0:14250:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784936787.661859:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f6959 00010000:00080000:0.0:1784936787.661902:0:14250:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096d7af8800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:0.0:1784936787.662117:0:14250:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1784936787.662896:0:14250:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784936787.662939:0:14250:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784936787.664495:0:14250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936787.664563:0:14250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1784936787.664714:0:14250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784936787.666328:0:14254:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784936787.666334:0:14254:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784936787.666938:0:14250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784936787.666949:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784936787.666984:0:14250:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784936787.667003:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f6960 00000100:00080000:1.0:1784936787.667013:0:14250:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784936787.667020:0:14250:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9096d7af8800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1784936787.667056:0:14250:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096d4664700 x1871641524130560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784936787.667084:0:14250:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784936787.667138:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936787.667141:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936787.667143:0:14250:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784936787.667146:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784936787.667148:0:14250:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1784936787.667149:0:14250:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784936787.667151:0:14250:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784936787.667152:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784936787.667154:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936787.667156:0:14250:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784936787.667157:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784936787.667161:0:14250:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784936787.667163:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936787.667164:0:14250:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784936787.667167:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784936787.667170:0:14250:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.101@tcp to nid 0x20000c0a8cc65 (192.168.204.101@tcp) 00000020:01000000:1.0:1784936787.667190:0:14250:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784936787.667192:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784936787.667203:0:14250:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9096ff880000) 00000020:00000080:1.0:1784936787.667213:0:14250:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784936787.667217:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784936787.667267:0:14250:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784936787.667272:0:14250:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784936787.667278:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6cf7a864723f696e 00010000:00080000:1.0:1784936787.667326:0:14250:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096d473e000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:1.0:1784936787.667541:0:14250:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1784936787.667703:0:14250:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784936787.667724:0:14250:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784936787.668207:0:14250:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784936787.668273:0:14250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784936787.668359:0:14250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1784936787.668591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524130560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784936787.668662:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871641524130560 offset 0 length 520: 4 00000040:00080000:0.0:1784936787.668995:0:14256:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784936787.669000:0:14256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784936787.669853:0:14250:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784936787.669865:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784936787.669896:0:14250:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784936787.669913:0:14250:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f6975 00000100:00080000:3.0:1784936787.669922:0:14250:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784936787.669928:0:14250:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9096d473e000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936787.669958:0:14250:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff425180 x1871641524130688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784936787.669982:0:14250:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784936787.670042:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936787.670046:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.670048:0:14250:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784936787.670051:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936787.670054:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.670055:0:14250:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784936787.670058:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784936787.670059:0:14250:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784936787.670062:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936787.670065:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.670066:0:14250:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784936787.670068:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936787.670070:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.670071:0:14250:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784936787.670074:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784936787.670104:0:14250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14250:1871641524130816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936787.670169:0:14250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936787.670203:0:14250:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c592bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936787.670225:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524130816 00000100:00100000:3.0:1784936787.670231:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524130816 00000100:00100000:3.0:1784936787.670268:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784936787.670276:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14250:x1871641524130816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936787.670539:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14250:x1871641524130816:12345-0@lo:502:llog_process_th.0 Request processed in 262us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936787.670547:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784936787.670600:0:14250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14250:1871641524130816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784936787.670624:0:14250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936787.670634:0:14250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936787.670635:0:14250:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784936787.670638:0:14250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1784936787.670792:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524130688:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784936787.670823:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871641524130688 offset 0 length 520: 4 00000020:01000000:0.0:1784936787.670856:0:14215:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1784936787.670876:0:14215:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784936787.670901:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6905 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.670919:0:14215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26ae00/0x6cf7a864723f68fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6905 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936787.670928:0:14215:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096ff4ed800 from 1 10000000:01000000:0.0:1784936787.670931:0:14215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784936787.670959:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.670967:0:14215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.670977:0:14215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.670992:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784936787.671019:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.671035:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.671054:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524130944 00000100:00100000:0.0:1784936787.671060:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524130944 00000100:00100000:0.0:1784936787.671083:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784936787.671089:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+9:14215:x1871641524130944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.671099:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936787.671114:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f697c expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.671134:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f697c expref: 10 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.671155:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f697c expref: 10 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.671164:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26a800, rc 0) 00000100:00100000:0.0:1784936787.671195:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+10:14215:x1871641524130944:12345-0@lo:101:mount.lustre.0 Request processed in 106us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.671202:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784936787.671239:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524130944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.671253:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.671262:0:14215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.671824:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131072:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784936787.671864:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.671879:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.671895:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131072 00000100:00100000:0.0:1784936787.671899:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131072 00000100:00100000:0.0:1784936787.671920:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936787.671926:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+10:14215:x1871641524131072:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784936787.671939:0:14225:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784936787.671945:0:14225:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1784936787.672002:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+10:14215:x1871641524131072:12345-0@lo:256:mount.lustre.0 Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.672009:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936787.672044:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131072:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784936787.672647:0:14215:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784936787.672656:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672665:0:14215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936787.672673:0:14215:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ff4ed800 from 1 10000000:01000000:0.0:1784936787.672675:0:14215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936787.672698:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672705:0:14215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672714:0:14215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.672727:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784936787.672758:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.672774:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096e0702e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.672791:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131200 00000100:00100000:0.0:1784936787.672795:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131200 00000100:00100000:0.0:1784936787.672816:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936787.672822:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+10:14215:x1871641524131200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.672830:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936787.672842:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f698a expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672870:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f698a expref: 11 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672878:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f698a expref: 11 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672886:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ac00, rc 0) 00000100:00100000:0.0:1784936787.672917:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524131200:12345-0@lo:101:mount.lustre.0 Request processed in 95us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.672923:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936787.672957:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936787.672969:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.672977:0:14215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.673021:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.673050:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.673061:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0c99480 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.673072:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131328 00000100:00100000:0.0:1784936787.673075:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131328 00000100:00100000:0.0:1784936787.673090:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784936787.673095:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524131328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.673481:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524131328:12345-0@lo:501:mount.lustre.0 Request processed in 384us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.673498:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784936787.673533:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.673557:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936787.673593:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.673606:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0c99480 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.673620:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131456 00000100:00100000:0.0:1784936787.673623:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131456 00000100:00100000:0.0:1784936787.673643:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784936787.673649:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524131456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936787.673790:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524131456:12345-0@lo:503:mount.lustre.0 Request processed in 140us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.673796:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784936787.673832:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936787.681217:0:14258:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14258:1871641524131584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936787.681500:0:14258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.681554:0:14258:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0c99840 going to sleep for 11 seconds 00000100:00100000:2.0:1784936787.681566:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131584 00000100:00100000:2.0:1784936787.681586:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131584 00000100:00100000:2.0:1784936787.681638:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784936787.681647:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14258:x1871641524131584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784936787.681934:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14258:x1871641524131584:12345-0@lo:502:llog_process_th.0 Request processed in 287us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936787.681941:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784936787.684321:0:14258:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14258:1871641524131584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784936787.684379:0:14258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936787.684397:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.684400:0:14258:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784936787.684410:0:14258:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096ff4ed800 00000020:00000080:0.0:1784936787.684413:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784936787.684424:0:14258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936787.684460:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.684463:0:14258:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784936787.684490:0:14258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936787.684495:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.684496:0:14258:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784936787.684501:0:14258:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096ff4ed800 00000020:00000080:0.0:1784936787.684504:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784936787.684575:0:14258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936787.684579:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.684580:0:14258:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784936787.684583:0:14258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936787.684585:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.684587:0:14258:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784936787.684591:0:14258:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9096ff4ed800 00000020:00000080:0.0:1784936787.684593:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784936787.684650:0:14258:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14258:1871641524131712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936787.684749:0:14258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.684799:0:14258:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0c99840 going to sleep for 11 seconds 00000100:00100000:1.0:1784936787.685796:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131712 00000100:00100000:1.0:1784936787.685806:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131712 00000100:00100000:1.0:1784936787.685852:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784936787.685861:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14258:x1871641524131712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936787.686101:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14258:x1871641524131712:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936787.686108:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784936787.686214:0:14258:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14258:1871641524131712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784936787.686247:0:14258:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936787.686254:0:14258:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936787.686256:0:14258:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784936787.686261:0:14258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784936787.686530:0:14215:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784936787.686550:0:14215:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784936787.687686:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.687701:0:14215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936787.687765:0:14215:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784936787.687769:0:14215:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9096ff4ed800 10000000:01000000:1.0:1784936787.687772:0:14215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9096ff4ed800 10000000:01000000:1.0:1784936787.687776:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784936787.687782:0:14215:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096ff4ed800 from 1 10000000:01000000:1.0:1784936787.687785:0:14215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784936787.687822:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.687841:0:14215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.687851:0:14215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936787.687878:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784936787.687937:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936787.687975:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1784936787.688643:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131840 00000100:00100000:3.0:1784936787.688652:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131840 00000100:00100000:3.0:1784936787.688711:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784936787.688720:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524131840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936787.688734:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936787.688750:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f699f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6998 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936787.688774:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f699f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6998 expref: 12 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936787.688802:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4600/0x6cf7a864723f699f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6998 expref: 12 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936787.688811:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4600, rc 0) 00000100:00100000:3.0:1784936787.688870:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14215:x1871641524131840:12345-0@lo:101:mount.lustre.0 Request processed in 150us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936787.688877:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784936787.688970:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131840:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784936787.688986:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f699f expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936787.688996:0:14215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f699f expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936787.689067:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784936787.689094:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936787.689121:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6000 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.689342:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524131968 00000100:00100000:0.0:1784936787.689347:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524131968 00000100:00100000:0.0:1784936787.689418:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784936787.689441:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14215:x1871641524131968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936787.689732:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14215:x1871641524131968:12345-0@lo:501:mount.lustre.0 Request processed in 306us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.689739:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784936787.695626:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524131968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784936787.695779:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524132096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936787.695854:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936787.695905:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6000 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.696055:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132096 00000100:00100000:0.0:1784936787.696068:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132096 00000100:00100000:0.0:1784936787.696117:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784936787.696127:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14215:x1871641524132096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936787.696336:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14215:x1871641524132096:12345-0@lo:503:mount.lustre.0 Request processed in 210us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.696343:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784936787.696837:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524132096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936787.697961:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14262:1871641524132224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936787.698027:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936787.698065:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.698117:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132224 00000100:00100000:0.0:1784936787.698124:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132224 00000100:00100000:0.0:1784936787.698164:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784936787.698173:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14262:x1871641524132224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784936787.698403:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14262:x1871641524132224:12345-0@lo:502:llog_process_th.0 Request processed in 230us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.698410:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784936787.698788:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14262:1871641524132224:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784936787.698862:0:14262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784936787.698876:0:14262:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9096ff883380) 00000020:00000080:1.0:1784936787.698898:0:14262:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1784936787.699071:0:14262:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096ff4ed800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784936787.699076:0:14262:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096ff4ed800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784936787.699079:0:14262:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096ff4ed800 4 00010000:00080000:1.0:1784936787.699109:0:14262:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096c722d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.101@tcp at head 00010000:00010000:1.0:1784936787.704652:0:14262:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1784936787.704765:0:14262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784936787.704802:0:14262:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784936787.704816:0:14262:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6cf7a864723f69ad 00000100:00080000:1.0:1784936787.704830:0:14262:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784936787.704836:0:14262:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9096c722d000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:1.0:1784936787.704874:0:14262:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096d4664380 x1871641524132352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784936787.704903:0:14262:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784936787.705176:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524132352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784936787.705250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936787.705500:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132352 00000100:00100000:1.0:1784936787.705509:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132352 00000100:00100000:1.0:1784936787.705544:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936787.705550:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524132352:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784936787.705604:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524132352:12345-0@lo:38:llog_process_th.0 Request processed in 52us (353us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784936787.705611:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936787.705712:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784936787.705722:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096c722d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784936787.705727:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784936787.705731:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524132352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784936787.707491:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14262:1871641524132480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784936787.707586:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936787.707626:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936787.707754:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132480 00000100:00100000:3.0:1784936787.707762:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132480 00000100:00100000:3.0:1784936787.707805:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784936787.707815:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14262:x1871641524132480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784936787.708053:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14262:x1871641524132480:12345-0@lo:502:llog_process_th.0 Request processed in 239us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936787.708061:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784936787.708234:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14262:1871641524132480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784936787.708267:0:14262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784936787.708355:0:14215:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784936787.708468:0:14215:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784936787.708486:0:14215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f699f expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.708497:0:14215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c8165a00/0x6cf7a864723f6998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f699f expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784936787.708549:0:14215:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784936787.708551:0:14215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784936787.708552:0:14215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936787.708553:0:14215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936787.708555:0:14215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936787.708556:0:14215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936787.708558:0:14215:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784936787.708559:0:14215:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784936787.708561:0:14215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936787.708561:0:14215:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936787.708566:0:14215:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784936787.708568:0:14215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784936787.708570:0:14215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784936787.708571:0:14215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936787.708572:0:14215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936787.708573:0:14215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936787.708574:0:14215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936787.708576:0:14215:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784936787.708577:0:14215:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784936787.708577:0:14215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936787.708578:0:14215:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936787.708593:0:14215:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784936787.708605:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524132608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784936787.708639:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.708662:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0c99f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784936787.709087:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132608 00000100:00100000:1.0:1784936787.709093:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132608 00000100:00100000:1.0:1784936787.709164:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784936787.709174:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14215:x1871641524132608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784936787.709201:0:14226:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784936787.709214:0:14226:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784936787.750278:0:14226:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784936787.750315:0:14226:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784936787.750464:0:14248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784936787.750470:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784936787.750496:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.750520:0:14248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f697c expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.750531:0:14248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.750582:0:14248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f697c expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.750603:0:14248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f697c expref: 12 pid: 14225 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936787.750617:0:14248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14248:1871641524132736:0@lo:104: 00000100:00100000:2.0:1784936787.750700:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936787.750771:0:14248:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784936787.751852:0:14216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132736 00000100:00100000:0.0:1784936787.751866:0:14216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132736 00000100:00100000:0.0:1784936787.751922:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936787.751932:0:14216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14248:x1871641524132736:12345-0@lo:104: 00010000:00010000:0.0:1784936787.751948:0:14216:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752036:0:14216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936787.752043:0:14216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14248:x1871641524132736:12345-0@lo:104: Request processed in 113us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.752049:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784936787.752075:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936787.752080:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752087:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936787.752091:0:14222:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752099:0:14222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936787.752105:0:14222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936787.752110:0:14222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784936787.752147:0:14222:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752154:0:14222:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784936787.752174:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752181:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096ee26b400/0x6cf7a864723f697c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6983 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752208:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936787.752210:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936787.752212:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936787.752305:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936787.752317:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3305:1871641524132864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784936787.752353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936787.752414:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132864 00000100:00100000:0.0:1784936787.752418:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132864 00010000:00010000:0.0:1784936787.752464:0:14218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f697c expref: 13 pid: 14225 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.752486:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784936787.752493:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+13:3305:x1871641524132864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784936787.752503:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936787.752509:0:14218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f697c expref: 13 pid: 14225 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752519:0:14218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f697c expref: 13 pid: 14225 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752536:0:14218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752543:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784936787.752558:0:14218:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002088565s 00010000:00010000:0.0:1784936787.752562:0:14218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752574:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752582:0:14218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752588:0:14218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752593:0:14218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936787.752596:0:14218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752603:0:14218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752611:0:14218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936787.752620:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936787.752650:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+13:3305:x1871641524132864:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936787.752658:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784936787.752836:0:14248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26a800/0x6cf7a864723f6983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f697c expref: 13 pid: 14225 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936787.752847:0:14248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14248:1871641524132736:0@lo:104: 00010000:00010000:2.0:1784936787.752864:0:14248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.752873:0:14248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.752880:0:14248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936787.752886:0:14248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f4d18a00/0x6cf7a864723f69b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936787.753127:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3305:1871641524132864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784936787.759484:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14215:x1871641524132608:12345-0@lo:253:mount.lustre.0 Request processed in 50302us (50834us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936787.759514:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784936787.759766:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14215:1871641524132608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784936787.759782:0:14215:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784936787.759786:0:14215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784936787.759788:0:14215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784936787.759795:0:14215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936787.759797:0:14215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936787.759798:0:14215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936787.759799:0:14215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936787.759801:0:14215:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784936787.759802:0:14215:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784936787.759804:0:14215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936787.759806:0:14215:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784936787.759823:0:14215:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784936787.765754:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936787.765915:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936787.766148:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936787.766511:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936787.766942:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936787.767099:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1784936787.768085:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1784936787.768324:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936787.769071:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936787.769387:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1784936787.769898:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1784936787.770070:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1784936787.814814:0:14215:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1784936787.815648:0:14215:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784936787.815731:0:14271:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784936787.815735:0:14271:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1784936787.816329:0:14272:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1784936787.816425:0:14272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1784936787.818558:0:14215:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784936787.818679:0:14215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784936787.820185:0:14272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784936787.820284:0:14272:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784936787.820298:0:14272:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1784936787.820806:0:14215:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784936787.820824:0:14215:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784936787.821089:0:14215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936787.825017:0:14215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784936787.825922:0:14215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784936787.826064:0:14215:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784936787.827490:0:14215:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1784936787.828242:0:14215:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1784936787.836495:0:14215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1784936787.875273:0:14215:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784936787.875329:0:14215:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3a5c1c4f988 00100000:10000000:0.0:1784936787.875337:0:14215:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784936787.876078:0:14215:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784936787.876095:0:14215:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784936787.876117:0:14215:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784936787.876143:0:14215:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1784936788.425978:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784936788.744705:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936788.744716:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936788.745111:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1784936788.745120:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1784936789.258610:0:14230:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784936789.258617:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096ff4ed800 from 6 10000000:01000000:3.0:1784936789.258621:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784936789.258679:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936789.258690:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936789.258702:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936789.258728:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524132992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784936789.258802:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936789.258856:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c59ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1784936789.258976:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524132992 00000100:00100000:1.0:1784936789.258984:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524132992 00000100:00100000:1.0:1784936789.259038:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784936789.259049:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14230:x1871641524132992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936789.259063:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936789.259078:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f69bb expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936789.259103:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936789.259129:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936789.259139:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164a00, rc 0) 00000100:00100000:1.0:1784936789.259192:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524132992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936789.259199:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784936789.259300:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524132992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936789.259316:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936789.259325:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936789.259389:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524133120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784936789.259424:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936789.259473:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a9480 going to sleep for 11 seconds 00000100:00100000:1.0:1784936789.259521:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524133120 00000100:00100000:1.0:1784936789.259525:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524133120 00000100:00100000:1.0:1784936789.259556:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784936789.259564:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524133120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784936789.259577:0:14226:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784936789.259593:0:14226:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784936789.259596:0:14226:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784936789.259685:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524133120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936789.259692:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784936789.259721:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524133120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784936789.259764:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784936789.259771:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936789.259779:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936789.452699:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784936789.770651:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784936789.770671:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784936789.770710:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1784936789.770717:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784936790.476233:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936791.502004:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936792.529896:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784936792.549119:0:14515:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1784936792.970596:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784936792.970604:0:11837:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784936792.970607:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784936792.970610:0:11837:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784936792.970612:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784936792.970615:0:11837:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784936792.970618:0:11837:0:(import.c:65:import_set_state_nolock()) ffff9096c722d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784936792.970631:0:11837:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9096c722d000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936792.970657:0:11837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff424700 x1871641524133376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784936792.970729:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784936792.970742:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524133248:0@lo:400:kworker.0 00000100:00100000:0.0:1784936792.970840:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524133376:0@lo:38:kworker.0 00000100:00100000:3.0:1784936792.970841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936792.970884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936792.970908:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524133248 00000100:00100000:3.0:1784936792.970916:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524133248 00000100:00100000:1.0:1784936792.970931:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524133376 00000100:00100000:1.0:1784936792.970938:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524133376 00000100:00100000:3.0:1784936792.970966:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784936792.970970:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936792.970980:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:3308:x1871641524133248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936792.970980:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1871641524133376:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784936792.971025:0:14234:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000100:00100000:3.0:1784936792.971040:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:3308:x1871641524133248:12345-0@lo:400:kworker.0 Request processed in 63us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936792.971047:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:1.0:1784936792.971061:0:14234:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6cf7a864723f69c9 00000004:00100000:1.0:1784936792.971078:0:14234:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784936792.971121:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524133248:0@lo:400:kworker.0 00000100:00080000:1.0:1784936792.971213:0:14234:0:(import.c:65:import_set_state_nolock()) ffff9096c4d77000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936792.971267:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1871641524133376:12345-0@lo:38:kworker.0 Request processed in 288us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936792.971288:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784936792.971950:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9096ff424700 x1871641524133376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784936802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784936792.971965:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784936792.971972:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784936792.971976:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784936792.971980:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096c722d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784936792.971986:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1871641524133376:0@lo:38:kworker.0 00010000:00010000:1.0:1784936793.557565:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936794.569086:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936795.599253:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784936796.140014:0:14666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc47f5b310 20000000:00000080:1.0:1784936796.140034:0:14666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9096ef6dd000 uarg=0000000000000000 20000000:01000000:1.0:1784936796.140067:0:14666:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784936796.140075:0:14666:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784936796.140080:0:14666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784936796.141156:0:14667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1784936796.141353:0:14666:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784936796.153422:0:14666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784936796.153481:0:14666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.153500:0:14666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f698a expref: 11 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.153533:0:14666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.153591:0:14666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f698a expref: 11 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.153607:0:14666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f698a expref: 11 pid: 14225 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936796.153627:0:14666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14666:1871641524133504:0@lo:104: 00000100:00100000:1.0:1784936796.153715:0:14666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936796.154330:0:14666:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936796.156830:0:14217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524133504 00000100:00100000:3.0:1784936796.156845:0:14217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524133504 00000100:00100000:3.0:1784936796.157847:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936796.157862:0:14217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14666:x1871641524133504:12345-0@lo:104: 00010000:00010000:3.0:1784936796.157890:0:14217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.158011:0:14217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784936796.158017:0:14217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14666:x1871641524133504:12345-0@lo:104: Request processed in 161us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936796.158024:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784936796.158118:0:14666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14666:1871641524133504:0@lo:104: 00010000:00010000:1.0:1784936796.158152:0:14666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936796.158819:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936796.158827:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936796.158836:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a200 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:0.0:1784936796.158840:0:14221:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936796.158848:0:14221:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784936796.158856:0:14221:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936796.158870:0:14221:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784936796.158917:0:14221:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936796.158924:0:14221:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784936796.158975:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524133632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936796.159035:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784936796.159126:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936796.159157:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096ee26a200/0x6cf7a864723f698a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6991 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936796.159398:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524133632 00000100:00100000:3.0:1784936796.159405:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524133632 00010000:00010000:3.0:1784936796.159446:0:14218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f698a expref: 12 pid: 14225 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936796.159471:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936796.159478:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:3308:x1871641524133632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784936796.159490:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936796.159495:0:14218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f698a expref: 12 pid: 14225 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.159520:0:14218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f698a expref: 12 pid: 14225 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.159536:0:14218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26ac00/0x6cf7a864723f6991 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f698a expref: 12 pid: 14225 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936796.169816:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936796.169825:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936796.169827:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936796.172105:0:14218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172125:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172162:0:14218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172199:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172207:0:14218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172214:0:14218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172220:0:14218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936796.172226:0:14218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172235:0:14218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172263:0:14218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936796.172278:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936796.172383:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:3308:x1871641524133632:12345-0@lo:103:ldlm_bl.0 Request processed in 12901us (13343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936796.172395:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936796.172802:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524133632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936796.172887:0:14666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.172896:0:14666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.172903:0:14666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c8164400/0x6cf7a864723f69d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936796.619776:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936797.067811:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784936787/real 1784936787] req@ffff9096ff425180 x1871641524130688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936797 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936797.067841:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9096ff425180 x1871641524130688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936797 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936797.067851:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784936787/real 1784936787] req@ffff9096d4664700 x1871641524130560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936797 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936797.067880:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9096d4664700 x1871641524130560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936797 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784936797.067898:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784936797.067919:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784936797.067923:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524130688:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784936797.067929:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d7af8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784936797.067935:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784936797.067938:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524130560:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784936797.068122:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784936797.068127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784936797.068130:0:36:0:(import.c:65:import_set_state_nolock()) ffff9096d7af8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784936797.068134:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784936797.068135:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1784936797.068140:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784936797.068146:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9096d7af8800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936797.068146:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524133760:0@lo:400:kworker.0 00000100:00100000:2.0:1784936797.068165:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096c8a3c000 x1871641524133888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784936797.068176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784936797.068179:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784936797.068180:0:36:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784936797.068182:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1784936797.068184:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784936797.068187:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9096d473e000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1784936797.068196:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096c8a3ed80 x1871641524134016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936797.068205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936797.068270:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524134144:0@lo:400:kworker.0 00000100:00100000:0.0:1784936797.068301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936797.068424:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134144 00000100:00100000:2.0:1784936797.068457:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134144 00000100:00100000:2.0:1784936797.068497:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784936797.068501:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524133760 00000100:00100000:3.0:1784936797.068504:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524133760 00000100:00100000:2.0:1784936797.068505:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524134144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936797.068529:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784936797.068535:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:3306:x1871641524133760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936797.068565:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524134144:12345-0@lo:400:kworker.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936797.068572:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:3306:x1871641524133760:12345-0@lo:400:kworker.0 Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936797.068572:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784936797.068577:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784936797.068607:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524133888:0@lo:8:kworker.0 00010000:00080000:2.0:1784936797.068607:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9096c8a3d180 x1871641524134144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936797.068618:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524134144:0@lo:400:kworker.0 00000100:00100000:2.0:1784936797.068626:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524133760:0@lo:400:kworker.0 00000400:00000100:3.0:1784936797.068641:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871641524133888 offset 0 length 520: 4 00000100:00100000:3.0:1784936797.068658:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524134016:0@lo:8:kworker.0 00000400:00000100:3.0:1784936797.068676:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871641524134016 offset 0 length 520: 4 10000000:01000000:2.0:1784936797.640714:0:14230:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784936797.640723:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ff4ed800 from 10 10000000:01000000:2.0:1784936797.640728:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784936797.640782:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936797.640793:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936797.640804:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936797.640831:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524134272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936797.640909:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936797.640972:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936797.641034:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134272 00000100:00100000:0.0:1784936797.641042:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134272 00000100:00100000:0.0:1784936797.641112:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784936797.641122:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+11:14230:x1871641524134272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936797.641136:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936797.641152:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f69d7 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936797.641178:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936797.641189:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936797.641198:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26b800, rc 0) 00000100:00100000:0.0:1784936797.641250:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524134272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936797.641257:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784936797.641307:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524134272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936797.641322:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936797.641331:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936797.641387:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524134400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936797.641449:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936797.641470:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936797.641493:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134400 00000100:00100000:0.0:1784936797.641497:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134400 00000100:00100000:0.0:1784936797.641518:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784936797.641524:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524134400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936797.642009:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524134400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936797.642017:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784936797.642052:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524134400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936797.642080:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524134528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936797.642128:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936797.642142:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04780 going to sleep for 11 seconds 00000100:00100000:0.0:1784936797.642155:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134528 00000100:00100000:0.0:1784936797.642159:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134528 00000100:00100000:0.0:1784936797.642187:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784936797.642193:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524134528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936797.642331:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14230:x1871641524134528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936797.642338:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784936797.642374:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524134528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784936797.644137:0:14710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784936797.644345:0:14230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784936797.644371:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936797.644382:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936797.644599:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936797.644905:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936798.665647:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936799.688657:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784936800.008731:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784936800.008740:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936800.009256:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1784936800.009320:0:14266:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936800.009367:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1784936800.713683:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784936801.236745:0:14867:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784936801.236749:0:14867:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1784936801.236858:0:14867:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9096c9b8b000 00000020:01000004:3.0:1784936801.236874:0:14867:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784936801.236887:0:14867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784936801.236917:0:14867:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9096f5098000) 00000020:00000080:3.0:1784936801.236935:0:14867:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784936801.266272:0:14867:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784936801.266596:0:14867:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784936801.268176:0:14867:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784936801.268408:0:14867:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784936801.268819:0:14867:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784936801.269234:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:2.0:1784936801.269391:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 465: rc = 0 00100000:10000000:2.0:1784936801.269612:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 465: rc = 0 00100000:10000000:2.0:1784936801.270215:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 574: rc = 0 00100000:10000000:2.0:1784936801.270579:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 574: rc = 0 00100000:10000000:2.0:1784936801.272252:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 574: rc = 0 00100000:10000000:2.0:1784936801.272589:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 574: rc = 0 00100000:10000000:2.0:1784936801.272946:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 574: rc = 0 00100000:10000000:2.0:1784936801.273373:0:14867:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 574: rc = 0 00000020:00000080:0.0:1784936801.274412:0:14867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1784936801.274424:0:14867:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784936801.274460:0:14867:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6cf7a864723f69ec 00000020:01000004:0.0:1784936801.274468:0:14867:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1784936801.274495:0:14867:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784936801.274498:0:14867:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784936801.274504:0:14867:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1784936801.274509:0:14867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1784936801.274519:0:14867:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9096fb8d99c0) 00000020:00000080:0.0:1784936801.274528:0:14867:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1784936801.276233:0:14867:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936801.276402:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784936801.276408:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784936801.277169:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784936801.277176:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784936801.283569:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784936801.283586:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784936801.286339:0:14867:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936801.286705:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784936801.286712:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784936801.287215:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784936801.287223:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784936801.305811:0:14867:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784936801.306052:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784936801.306058:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784936801.316152:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784936801.316165:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784936801.317088:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784936801.317098:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784936801.319298:0:14867:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784936801.319511:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784936801.319518:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784936801.326509:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784936801.326534:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784936801.392047:0:14867:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784936801.392231:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784936801.392238:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784936801.397216:0:14867:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784936801.397230:0:14867:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784936801.400242:0:14867:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784936801.400268:0:14867:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784936801.400275:0:14867:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784936801.423925:0:14867:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784936801.423966:0:14867:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.101@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784936801.423971:0:14867:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784936801.423972:0:14867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936801.423974:0:14867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936801.423975:0:14867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936801.423976:0:14867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936801.423978:0:14867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936801.423979:0:14867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936801.423981:0:14867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936801.423982:0:14867:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936801.423986:0:14867:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784936801.423988:0:14867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784936801.423989:0:14867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936801.423990:0:14867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936801.423991:0:14867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936801.423992:0:14867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936801.423993:0:14867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936801.423994:0:14867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936801.423995:0:14867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936801.423996:0:14867:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784936801.424047:0:14867:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784936801.424069:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524134656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784936801.424151:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936801.424307:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8374e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936801.427099:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134656 00000100:00100000:0.0:1784936801.427112:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134656 00000100:00100000:0.0:1784936801.427237:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784936801.427247:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14867:x1871641524134656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784936801.427287:0:14226:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784936801.427290:0:14226:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784936801.427294:0:14226:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784936801.517419:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14867:x1871641524134656:12345-0@lo:253:mount.lustre.0 Request processed in 90154us (93248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.517466:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784936801.517848:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524134656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784936801.517867:0:14867:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784936801.517871:0:14867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784936801.517873:0:14867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784936801.517874:0:14867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936801.517875:0:14867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936801.517876:0:14867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936801.517878:0:14867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936801.517879:0:14867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936801.517881:0:14867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936801.517882:0:14867:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784936801.517905:0:14867:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9096c9b8b000 from lustre-OST0000 10000000:01000000:2.0:1784936801.517945:0:14867:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784936801.517949:0:14867:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784936801.517956:0:14867:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9096d0c00000 local copy 00010000:00010000:2.0:1784936801.517966:0:14867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936801.518223:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524134784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936801.518264:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936801.518315:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c38146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.518907:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134784 00000100:00100000:3.0:1784936801.518915:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134784 00000100:00100000:3.0:1784936801.518960:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784936801.518969:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14867:x1871641524134784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936801.519275:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14867:x1871641524134784:12345-0@lo:501:mount.lustre.0 Request processed in 305us (1009us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784936801.519284:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784936801.519676:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524134784:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784936801.519695:0:14867:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784936801.519932:0:14867:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784936801.519940:0:14867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.519950:0:14867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936801.519986:0:14867:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9096c9b8b000 10000000:01000000:0.0:1784936801.519992:0:14867:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784936801.519997:0:14867:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9096d0c00000 10000000:01000000:0.0:1784936801.519999:0:14867:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1784936801.520003:0:14867:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9096d0c00000 from 1 10000000:01000000:0.0:1784936801.520006:0:14867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784936801.520050:0:14867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.520058:0:14867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.520068:0:14867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936801.520087:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524134912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784936801.520128:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.520212:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.520262:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524134912 00000100:00100000:3.0:1784936801.520269:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524134912 00000100:00100000:3.0:1784936801.520316:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784936801.520325:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+12:14867:x1871641524134912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936801.520533:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936801.520557:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4a00/0x6cf7a864723f6a01 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f69fa expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.520660:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4a00/0x6cf7a864723f6a01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f69fa expref: 13 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.520671:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4a00/0x6cf7a864723f6a01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f69fa expref: 13 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.520680:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4a00, rc 0) 00000100:00100000:3.0:1784936801.520845:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+13:14867:x1871641524134912:12345-0@lo:101:mount.lustre.0 Request processed in 520us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.520852:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784936801.520920:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524134912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936801.520936:0:14867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a01 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.520945:0:14867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6a01 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936801.520962:0:14867:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784936801.520984:0:14867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a01 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.521002:0:14867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26a400/0x6cf7a864723f69fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a01 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936801.521011:0:14867:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784936801.521015:0:14867:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784936801.521020:0:14867:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784936801.521022:0:14867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784936801.521049:0:14867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.521057:0:14867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.521065:0:14867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936801.521079:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784936801.521110:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.521176:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.521255:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135040 00000100:00100000:3.0:1784936801.521260:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135040 00000100:00100000:3.0:1784936801.521328:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784936801.521335:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+13:14867:x1871641524135040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936801.521553:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936801.521638:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f6a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6a08 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.521657:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f6a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6a08 expref: 14 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.521666:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5000/0x6cf7a864723f6a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6a08 expref: 14 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.521672:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5000, rc 0) 00000100:00100000:3.0:1784936801.521816:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135040:12345-0@lo:101:mount.lustre.0 Request processed in 480us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.521832:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784936801.521928:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936801.521940:0:14867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a0f expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.521949:0:14867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6a0f expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784936801.523158:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1784936801.524835:0:14867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936801.525118:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1784936801.525161:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1784936801.525191:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1784936801.525239:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1784936801.525277:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1784936801.525313:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1784936801.525809:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1784936801.525819:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1784936801.525919:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936801.525986:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.526108:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.526189:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135168 00000100:00100000:3.0:1784936801.526198:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135168 00000100:00100000:3.0:1784936801.526306:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784936801.526317:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936801.527202:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135168:12345-0@lo:501:mount.lustre.0 Request processed in 884us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.527212:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784936801.527294:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936801.527334:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936801.527666:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.527805:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.527842:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135296 00000100:00100000:3.0:1784936801.527848:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135296 00000100:00100000:3.0:1784936801.527931:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784936801.527939:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784936801.528311:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135296:12345-0@lo:503:mount.lustre.0 Request processed in 372us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.528319:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784936801.528412:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784936801.529059:0:14867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784936801.529132:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784936801.529183:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.530422:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936801.530833:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135424 00000100:00100000:2.0:1784936801.530843:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135424 00000100:00100000:2.0:1784936801.530892:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784936801.530903:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936801.531275:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135424:12345-0@lo:502:mount.lustre.0 Request processed in 372us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936801.531284:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784936801.531695:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784936801.536133:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784936801.536197:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784936801.536231:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784936801.536280:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784936801.536315:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784936801.537151:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1784936801.537257:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1784936801.537296:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1784936801.537329:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1784936801.537663:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1784936801.537834:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1784936801.537885:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1784936801.537935:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784936801.538016:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.538134:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784936801.538187:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135552 00000100:00100000:2.0:1784936801.538195:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135552 00000100:00100000:2.0:1784936801.538246:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784936801.538255:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936801.538967:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135552:12345-0@lo:502:mount.lustre.0 Request processed in 711us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936801.538976:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784936801.539959:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784936801.540117:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1784936801.540133:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1784936801.542073:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784936801.542084:0:14883:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784936801.542092:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936801.542094:0:14883:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784936801.542100:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784936801.542114:0:14883:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9096f509cd40) 00000020:00000080:3.0:1784936801.542139:0:14883:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784936801.542148:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784936801.542233:0:14883:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096c9b8b000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784936801.542241:0:14883:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784936801.542248:0:14883:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6cf7a864723f6a1d 00010000:00010000:2.0:1784936801.565202:0:14883:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1784936801.566496:0:14883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1784936801.570972:0:14883:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1784936801.606233:0:14883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1784936801.606249:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936801.606257:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.606259:0:14883:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1784936801.606265:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784936801.606268:0:14883:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784936801.606270:0:14883:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784936801.606271:0:14883:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784936801.606273:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784936801.606276:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.606277:0:14883:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784936801.606280:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936801.606283:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.606285:0:14883:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784936801.606288:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784936801.606290:0:14883:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784936801.606292:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936801.606294:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.606295:0:14883:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784936801.606298:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936801.606300:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.606301:0:14883:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784936801.606305:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784936801.606383:0:14883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936801.606386:0:14883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.606388:0:14883:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784936801.606392:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1784936801.612716:0:14867:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1784936801.612767:0:14867:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784936801.612787:0:14867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a0f expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.612800:0:14867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26a600/0x6cf7a864723f6a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a0f expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936801.612810:0:14867:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096c9b8b000 from 1 10000000:01000000:2.0:1784936801.612813:0:14867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784936801.612855:0:14867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.612864:0:14867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.612875:0:14867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936801.612899:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784936801.612986:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936801.613039:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c592b000 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.618530:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135680 00000100:00100000:3.0:1784936801.618545:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135680 00000100:00100000:3.0:1784936801.618621:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784936801.618630:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+14:14867:x1871641524135680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936801.618647:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936801.618668:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6a24 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.618697:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 15 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.618708:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 15 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.618718:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5e00, rc 0) 00000100:00100000:3.0:1784936801.618792:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524135680:12345-0@lo:101:mount.lustre.0 Request processed in 163us (5806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.618800:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784936801.619745:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784936801.619767:0:14867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.619778:0:14867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784936801.621602:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784936801.622259:0:14867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784936801.622552:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784936801.622603:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784936801.622670:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784936801.622679:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784936801.622766:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784936801.622835:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936801.622897:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784936801.623183:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135808 00000100:00100000:2.0:1784936801.623190:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135808 00000100:00100000:2.0:1784936801.623241:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784936801.623251:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524135808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936801.627735:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524135808:12345-0@lo:501:mount.lustre.0 Request processed in 4477us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936801.627762:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784936801.629165:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784936801.629223:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936801.629282:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936801.629332:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6600 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.629724:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524135936 00000100:00100000:3.0:1784936801.629731:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524135936 00000100:00100000:3.0:1784936801.629789:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784936801.629798:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524135936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784936801.630034:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524135936:12345-0@lo:503:mount.lustre.0 Request processed in 227us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.630042:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784936801.631719:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524135936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784936801.633937:0:14867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784936801.634048:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784936801.634130:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936801.634179:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ef0a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936801.634301:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136064 00000100:00100000:2.0:1784936801.634308:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136064 00000100:00100000:2.0:1784936801.634356:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784936801.634365:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524136064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936801.634896:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524136064:12345-0@lo:502:mount.lustre.0 Request processed in 530us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936801.634904:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784936801.641094:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784936801.641510:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784936801.642828:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784936801.643749:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784936801.643800:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784936801.644202:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784936801.644262:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784936801.644302:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784936801.644333:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784936801.644389:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784936801.645787:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936801.645844:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.646551:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136192 00000100:00100000:3.0:1784936801.646579:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136192 00000100:00100000:3.0:1784936801.646634:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784936801.646644:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524136192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784936801.646918:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524136192:12345-0@lo:502:mount.lustre.0 Request processed in 274us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.646926:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784936801.647234:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784936801.647404:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1784936801.647420:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1784936801.650136:0:14887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936801.650149:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.650151:0:14887:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784936801.650158:0:14887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096c9b8b000 00000020:00000080:1.0:1784936801.650161:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784936801.650168:0:14887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936801.650171:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.650172:0:14887:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784936801.650174:0:14887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936801.650176:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.650178:0:14887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784936801.650181:0:14887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096c9b8b000 00000020:00000080:1.0:1784936801.650183:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784936801.650297:0:14887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936801.650302:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.650303:0:14887:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784936801.650305:0:14887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784936801.650308:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.650309:0:14887:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784936801.650313:0:14887:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9096c9b8b000 00000020:00000080:1.0:1784936801.650315:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784936801.655659:0:14887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784936801.655672:0:14887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784936801.655674:0:14887:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784936801.655690:0:14887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1784936801.660542:0:14867:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784936801.660590:0:14867:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784936801.660615:0:14867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.660629:0:14867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936801.660683:0:14867:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784936801.660686:0:14867:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9096c9b8b000 10000000:01000000:3.0:1784936801.660689:0:14867:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9096c9b8b000 10000000:01000000:3.0:1784936801.660693:0:14867:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784936801.660699:0:14867:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096c9b8b000 from 1 10000000:01000000:3.0:1784936801.660702:0:14867:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784936801.660738:0:14867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.660747:0:14867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.660758:0:14867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936801.660782:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784936801.660855:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936801.660900:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c647ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936801.662125:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136320 00000100:00100000:1.0:1784936801.662138:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136320 00000100:00100000:1.0:1784936801.662200:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784936801.662210:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524136320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784936801.662226:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936801.662243:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8164400/0x6cf7a864723f6a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6a32 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.662559:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164400/0x6cf7a864723f6a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6a32 expref: 16 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.662575:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8164400/0x6cf7a864723f6a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6a32 expref: 16 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.662584:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164400, rc 0) 00000100:00100000:1.0:1784936801.662671:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136320:12345-0@lo:101:mount.lustre.0 Request processed in 462us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936801.662687:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784936801.663790:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936801.663813:0:14867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a39 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936801.663825:0:14867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6a39 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784936801.665042:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1784936801.667285:0:14867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784936801.674951:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784936801.675058:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784936801.675092:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784936801.675136:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784936801.675169:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784936801.675232:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784936801.675272:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784936801.675300:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784936801.675366:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784936801.675398:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784936801.675425:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784936801.675500:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784936801.675541:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784936801.683210:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784936801.683378:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784936801.683419:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784936801.683496:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784936801.683547:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784936801.683583:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784936801.683619:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784936801.683713:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784936801.683753:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784936801.683791:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784936801.683841:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784936801.683901:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1784936801.686874:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1784936801.686964:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1784936801.687003:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1784936801.687104:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1784936801.687112:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1784936801.687227:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936801.687287:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936801.687328:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c647ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936801.687584:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136448 00000100:00100000:2.0:1784936801.687592:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136448 00000100:00100000:2.0:1784936801.687650:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784936801.687658:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936801.687900:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136448:12345-0@lo:501:mount.lustre.0 Request processed in 242us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936801.687908:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784936801.688962:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936801.689010:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784936801.689076:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936801.689263:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c647ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936801.695121:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136576 00000100:00100000:1.0:1784936801.695146:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136576 00000100:00100000:1.0:1784936801.695206:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784936801.695215:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936801.695646:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136576:12345-0@lo:503:mount.lustre.0 Request processed in 431us (6568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936801.695655:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784936801.696306:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784936801.703518:0:14867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784936801.703613:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784936801.705288:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936801.705500:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff9f6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784936801.712778:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136704 00000100:00100000:2.0:1784936801.712912:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136704 00000100:00100000:2.0:1784936801.712983:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784936801.712993:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936801.713645:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136704:12345-0@lo:502:mount.lustre.0 Request processed in 650us (8359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936801.713654:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784936801.722574:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784936801.723894:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784936801.723972:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1784936801.724004:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1784936801.724078:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1784936801.724125:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1784936801.724173:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1784936801.724208:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1784936801.724236:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1784936801.724279:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784936801.726875:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784936801.726991:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784936801.727081:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784936801.727122:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784936801.727178:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784936801.727225:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784936801.727261:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784936801.727297:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784936801.727375:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784936801.727419:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784936801.727487:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784936801.727542:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784936801.727578:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784936801.727614:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784936801.727685:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784936801.727724:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1784936801.727760:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1784936801.727814:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1784936801.727852:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1784936801.727888:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1784936801.727965:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1784936801.728005:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1784936801.728052:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1784936801.728087:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1784936801.728136:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1784936801.728172:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1784936801.728220:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1784936801.728257:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1784936801.728286:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1784936801.728335:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1784936801.728372:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1784936801.728445:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784936801.728528:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.728569:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936801.728827:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136832 00000100:00100000:1.0:1784936801.728836:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136832 00000100:00100000:1.0:1784936801.728882:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784936801.728891:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784936801.729149:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524136832:12345-0@lo:502:mount.lustre.0 Request processed in 258us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936801.729157:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784936801.731642:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524136832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784936801.731823:0:14867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784936801.731844:0:14867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784936801.746254:0:14892:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784936801.746273:0:14892:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9096c9b60000) 00000020:00000080:2.0:1784936801.746295:0:14892:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1784936801.746525:0:14892:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096c9b8b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784936801.746530:0:14892:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096c9b8b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784936801.746533:0:14892:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096c9b8b000 3 00010000:00080000:2.0:1784936801.746570:0:14892:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9096e8582800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.101@tcp at head 00010000:00010000:2.0:1784936801.748471:0:14892:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1784936801.748586:0:14892:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784936801.748621:0:14892:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784936801.748634:0:14892:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6cf7a864723f6a47 00000100:00080000:2.0:1784936801.748646:0:14892:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784936801.748652:0:14892:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9096e8582800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1784936801.748692:0:14892:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096c8a3ce00 x1871641524136960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784936801.748730:0:14892:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784936801.748758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784936801.748763:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784936801.748766:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784936801.748769:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784936801.751138:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1871641524136960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784936801.751211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784936801.754455:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936801.754489:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524137088:0@lo:400:kworker.0 00000100:00100000:0.0:1784936801.754560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.754624:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524136960 00000100:00100000:0.0:1784936801.754631:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524136960 00000100:00100000:0.0:1784936801.754666:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137088 00000100:00100000:0.0:1784936801.754669:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137088 00000100:00100000:0.0:1784936801.754694:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936801.754702:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524137088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936801.754756:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524137088:12345-0@lo:400:kworker.0 Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936801.754764:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936801.754781:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936801.754785:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1871641524136960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784936801.754806:0:14233:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1784936801.754852:0:14233:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6cf7a864723f6a4e 00000004:00100000:0.0:1784936801.754868:0:14233:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784936801.754900:0:14233:0:(import.c:65:import_set_state_nolock()) ffff9096e0613800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936801.754941:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1871641524136960:12345-0@lo:38:llog_process_th.0 Request processed in 154us (3729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936801.754947:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784936801.754997:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096c8a3ce00 x1871641524136960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784936811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936801.755008:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784936801.755017:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1784936801.755036:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784936801.755040:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784936801.755043:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096e8582800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784936801.755048:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1871641524136960:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784936801.755078:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096c8a3f480 x1871641524137088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936801.755098:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524137088:0@lo:400:kworker.0 00000040:00080000:1.0:1784936801.760013:0:14892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1784936801.763514:0:14867:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784936801.763572:0:14867:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784936801.763605:0:14867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a39 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.763617:0:14867:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea5200/0x6cf7a864723f6a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a39 expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784936801.763694:0:14867:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784936801.763696:0:14867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784936801.763698:0:14867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936801.763699:0:14867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936801.763700:0:14867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936801.763702:0:14867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936801.763703:0:14867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936801.763705:0:14867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936801.763706:0:14867:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936801.763709:0:14867:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784936801.763712:0:14867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784936801.763713:0:14867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784936801.763715:0:14867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936801.763716:0:14867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936801.763717:0:14867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936801.763718:0:14867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936801.763719:0:14867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936801.763720:0:14867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936801.763721:0:14867:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936801.763752:0:14867:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784936801.763773:0:14867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524137216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784936801.763863:0:14867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.763920:0:14867:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a55600 going to sleep for 11 seconds 00000100:00100000:3.0:1784936801.765857:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137216 00000100:00100000:3.0:1784936801.765870:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137216 00000100:00100000:3.0:1784936801.765981:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784936801.765992:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14867:x1871641524137216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784936801.766039:0:14226:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784936801.766065:0:14226:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784936801.841847:0:14226:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784936801.841876:0:14226:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784936801.841979:0:14248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784936801.841996:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784936801.842015:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.842043:0:14248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 16 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.842052:0:14248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.842089:0:14248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 16 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.842104:0:14248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 16 pid: 14225 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936801.842118:0:14248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14248:1871641524137344:0@lo:104: 00000100:00100000:0.0:1784936801.842182:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936801.842254:0:14248:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a55e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936801.843188:0:14216:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137344 00000100:00100000:1.0:1784936801.843198:0:14216:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137344 00000100:00100000:1.0:1784936801.843252:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784936801.843262:0:14216:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14248:x1871641524137344:12345-0@lo:104: 00010000:00010000:1.0:1784936801.843276:0:14216:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.843356:0:14216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784936801.843362:0:14216:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14248:x1871641524137344:12345-0@lo:104: Request processed in 102us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936801.843369:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784936801.843392:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936801.843409:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.843417:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936801.843421:0:14222:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.843446:0:14222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936801.843453:0:14222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936801.843469:0:14222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784936801.843500:0:14222:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.843507:0:14222:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936801.843527:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.843533:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4c00/0x6cf7a864723f69bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f69c2 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936801.843552:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936801.843554:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936801.843555:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936801.844105:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524137472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936801.844148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936801.844257:0:14220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137472 00000100:00100000:2.0:1784936801.844263:0:14220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137472 00010000:00010000:2.0:1784936801.844288:0:14220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 17 pid: 14225 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936801.844322:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784936801.844330:0:14220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:3308:x1871641524137472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936801.844342:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936801.844347:0:14220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 17 pid: 14225 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844360:0:14220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 17 pid: 14225 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844377:0:14220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844386:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784936801.844413:0:14220:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002417093s 00010000:00010000:2.0:1784936801.844418:0:14220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844460:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844467:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844473:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844480:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936801.844484:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844491:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844501:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936801.844511:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936801.844555:0:14220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:3308:x1871641524137472:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (406us total) trans 0 rc 0/0 00010000:00010000:0.0:1784936801.845054:0:14248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f69c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f69bb expref: 17 pid: 14225 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936801.845069:0:14248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14248:1871641524137344:0@lo:104: 00010000:00010000:0.0:1784936801.845092:0:14248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.845101:0:14248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.845108:0:14248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936801.845127:0:14248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26aa00/0x6cf7a864723f6a55 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936801.845687:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524137472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936801.845780:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936801.854207:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14867:x1871641524137216:12345-0@lo:253:mount.lustre.0 Request processed in 88206us (90334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936801.854222:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784936801.854315:0:14867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14867:1871641524137216:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784936801.854332:0:14867:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784936801.854336:0:14867:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784936801.854338:0:14867:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784936801.854340:0:14867:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936801.854341:0:14867:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936801.854342:0:14867:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936801.854343:0:14867:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936801.854345:0:14867:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936801.854346:0:14867:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936801.854348:0:14867:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784936801.854364:0:14867:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784936801.862938:0:14867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936801.863173:0:14867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784936801.863359:0:14867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936801.863853:0:14867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784936801.864013:0:14867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936801.864207:0:14867:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784936801.865196:0:14867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1784936801.929013:0:14867:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784936801.929032:0:14867:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784936801.929067:0:14867:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784936801.929133:0:14867:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784936801.929145:0:14867:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784936801.929172:0:14867:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1784936802.770490:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784936803.468894:0:14230:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784936803.468909:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096ff4ed800 from 7 10000000:01000000:2.0:1784936803.468917:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784936803.469021:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936803.469037:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936803.469051:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936803.469088:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524137600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936803.469203:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936803.469287:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa53000 going to sleep for 11 seconds 00000100:00100000:0.0:1784936803.470637:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137600 00000100:00100000:0.0:1784936803.470656:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137600 00000100:00100000:0.0:1784936803.470731:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784936803.470744:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+15:14230:x1871641524137600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936803.470766:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936803.470791:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6a5c expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936803.470825:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 16 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936803.470838:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 16 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936803.470849:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ba00, rc 0) 00000100:00100000:0.0:1784936803.470948:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14230:x1871641524137600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936803.470956:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784936803.471033:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524137600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936803.471053:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936803.471064:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936803.471132:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524137728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784936803.471170:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936803.471197:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0a55e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936803.471415:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137728 00000100:00100000:3.0:1784936803.471421:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137728 00000100:00100000:3.0:1784936803.471494:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784936803.471502:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14230:x1871641524137728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784936803.471630:0:14227:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784936803.471654:0:14227:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784936803.471657:0:14227:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784936803.471766:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14230:x1871641524137728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 264us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936803.471773:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784936803.472569:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524137728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784936803.472669:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784936803.472679:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936803.472691:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936803.786238:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936804.809638:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936805.832862:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784936806.792973:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784936806.792980:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784936806.792982:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784936806.792986:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784936806.793173:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3305:1871641524137856:0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936806.793313:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936806.793319:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524137984:0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936806.793391:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524138112:0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936806.793480:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137856 00000100:00100000:0.0:1784936806.793486:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137856 00000100:00100000:0.0:1784936806.793525:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784936806.793533:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3305:x1871641524137856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793577:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3305:x1871641524137856:12345-0@lo:400:kworker.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936806.793585:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784936806.793613:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524137984 00000100:00100000:0.0:1784936806.793616:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524137984 00000100:00100000:0.0:1784936806.793639:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138112 00000100:00100000:0.0:1784936806.793642:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138112 00000100:00100000:0.0:1784936806.793670:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936806.793676:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524137984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793707:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524137984:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936806.793712:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784936806.793725:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784936806.793731:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524138112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793762:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524138112:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936806.793768:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784936806.793806:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f5040700 x1871641524137984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936806.793819:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524137984:0@lo:400:kworker.0 00000100:00100000:0.0:1784936806.793839:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3305:1871641524137856:0@lo:400:kworker.0 00010000:00080000:0.0:1784936806.793875:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f5042300 x1871641524138112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936806.793885:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524138112:0@lo:400:kworker.0 00000100:00080000:3.0:1784936806.798576:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936806.856658:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936807.881147:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936808.906220:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936809.929803:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784936810.249045:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1784936810.695977:0:15237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784936810.955594:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784936811.912707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784936811.912714:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784936811.912717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784936811.912720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784936811.912759:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936811.912784:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524138240:0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.912884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936811.912942:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524138368:0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.912969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936811.912990:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936811.912995:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524138496:0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.913024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936811.913059:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138240 00000100:00100000:0.0:1784936811.913067:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138240 00000100:00100000:0.0:1784936811.913118:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784936811.913127:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3307:x1871641524138240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.913176:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3307:x1871641524138240:12345-0@lo:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936811.913183:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784936811.913240:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138368 00000100:00100000:0.0:1784936811.913245:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138368 00000100:00100000:0.0:1784936811.913269:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138496 00000100:00100000:0.0:1784936811.913271:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138496 00000100:00100000:0.0:1784936811.913297:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784936811.913304:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524138368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.913338:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524138368:12345-0@lo:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936811.913344:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784936811.913355:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936811.913362:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524138496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.913386:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524138496:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936811.913392:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784936811.913646:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f5040700 x1871641524138496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936811.913660:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524138496:0@lo:400:kworker.0 00010000:00080000:0.0:1784936811.913675:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096f5042a00 x1871641524138368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936811.913683:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524138368:0@lo:400:kworker.0 00000100:00100000:0.0:1784936811.913714:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524138240:0@lo:400:kworker.0 00000100:00080000:3.0:1784936811.913891:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784936811.977051:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936813.002953:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784936797/real 1784936797] req@ffff9096c8a3c000 x1871641524133888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936813.003002:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9096c8a3c000 x1871641524133888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936813.003014:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784936797/real 1784936797] req@ffff9096c8a3ed80 x1871641524134016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936813.003028:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9096c8a3ed80 x1871641524134016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784936812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784936813.003053:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d7af8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784936813.003089:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784936813.003095:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524133888:0@lo:8:kworker.0 00000100:00080000:1.0:1784936813.003102:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784936813.003108:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784936813.003112:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524134016:0@lo:8:kworker.0 00000100:00080000:3.0:1784936813.004131:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784936813.004138:0:11837:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784936813.004142:0:11837:0:(import.c:65:import_set_state_nolock()) ffff9096d7af8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784936813.004149:0:11837:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1784936813.004157:0:11837:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784936813.004167:0:11837:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9096d7af8800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936813.004195:0:11837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff426300 x1871641524138752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784936813.004238:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784936813.004243:0:11837:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784936813.004245:0:11837:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784936813.004249:0:11837:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1784936813.004252:0:11837:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784936813.004257:0:11837:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9096d473e000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936813.004271:0:11837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff427480 x1871641524138880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936813.004392:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524138624:0@lo:400:kworker.0 00000100:00100000:0.0:1784936813.004570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936813.004825:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784936813.004834:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524139008:0@lo:400:kworker.0 00000100:00100000:0.0:1784936813.004878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936813.004924:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524139136:0@lo:400:kworker.0 00010000:00010000:2.0:1784936813.004950:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936813.004956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936813.004998:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139008 00000100:00100000:0.0:1784936813.005007:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139008 00000100:00100000:0.0:1784936813.005059:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139136 00000100:00100000:0.0:1784936813.005063:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139136 00000100:00100000:2.0:1784936813.005097:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784936813.005112:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524139008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936813.005157:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524138752:0@lo:8:kworker.0 00000100:00100000:2.0:1784936813.005189:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524139008:12345-0@lo:400:kworker.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936813.005249:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138624 00000100:00100000:3.0:1784936813.005254:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138624 00000100:00100000:3.0:1784936813.005314:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784936813.005336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936813.005366:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3307:x1871641524138624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936813.007783:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936813.007829:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936813.007968:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936813.008263:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3307:x1871641524138624:12345-0@lo:400:kworker.0 Request processed in 2938us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936813.008273:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1784936813.008317:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936813.008564:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138752 00000100:00100000:2.0:1784936813.008576:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138752 00000100:00100000:2.0:1784936813.008962:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936813.008990:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1871641524138752:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784936813.009039:0:14868:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1784936813.009088:0:14868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f6a6a 00002000:00100000:2.0:1784936813.009111:0:14868:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9096e8585800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784936813.009118:0:14868:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784936813.009122:0:14868:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784936813.009907:0:14868:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784936813.009958:0:14868:0:(import.c:65:import_set_state_nolock()) ffff9096e8581800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784936813.010074:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1871641524138752:12345-0@lo:8:kworker.0 Request processed in 1082us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936813.010085:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784936813.010451:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096ff424380 x1871641524139008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936813.010471:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524139008:0@lo:400:kworker.0 00000100:00100000:2.0:1784936813.010487:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524138624:0@lo:400:kworker.0 00010000:00080000:1.0:1784936813.010827:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096ff426300 x1871641524138752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784936833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936813.010837:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784936813.010849:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784936813.010877:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784936813.010885:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784936813.010890:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d7af8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784936813.010891:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524139136:12345-0@lo:400:kworker.0 Request processed in 2938us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936813.010905:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1784936813.010921:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784936813.010927:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524138752:0@lo:8:kworker.0 00000004:00080000:0.0:1784936813.010938:0:14254:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784936813.010939:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524138880:0@lo:8:kworker.0 00000100:00100000:1.0:1784936813.010992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784936813.011539:0:14254:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 478763109835ns, next at 0ns, rc = 0 00000004:00080000:3.0:1784936813.011977:0:14255:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1784936813.012018:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14255:1871641524139392:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784936813.012071:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936813.012099:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936813.012133:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524138880 00000100:00100000:3.0:1784936813.012140:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524138880 00000100:00100000:3.0:1784936813.012171:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139392 00000100:00100000:3.0:1784936813.012175:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139392 00000100:00100000:3.0:1784936813.012216:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936813.012225:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1871641524138880:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784936813.012259:0:14871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784936813.012311:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1871641524138880:12345-0@lo:8:kworker.0 Request processed in 85us (1318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784936813.012318:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936813.012334:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936813.012342:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14255:x1871641524139392:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1784936813.013323:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784936813.013333:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784936813.013338:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524138880:0@lo:8:kworker.0 00000100:00100000:0.0:1784936813.013638:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524139264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936813.013695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936813.016146:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139264 00000100:00100000:1.0:1784936813.016166:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139264 00000100:00100000:1.0:1784936813.016238:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936813.016250:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524139264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936813.016300:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936813.016664:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524139264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936813.016673:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784936813.016899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096ff425c00 x1871641524139264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784936813.016928:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524139264:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1784936813.020204:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9096ff425880 x1871641524139136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784936813.020230:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524139136:0@lo:400:kworker.0 00000100:00080000:0.0:1784936813.021199:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1784936813.024758:0:14871:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1784936813.024774:0:14871:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784936813.024782:0:14871:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1784936813.040516:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936813.040535:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.040557:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1784936813.040563:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936813.040572:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.040595:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.040610:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.040620:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.040881:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784936813.041986:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936813.041998:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.042017:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1784936813.042022:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936813.042030:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.042047:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.042057:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.042066:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.048091:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784936813.048126:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.048139:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.048158:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.048177:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.048192:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.048224:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.050243:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.051797:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.051850:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.051852:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.051854:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.052223:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.052226:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.053139:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936813.056255:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936813.056283:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936813.056301:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936813.056316:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936813.056352:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936813.056361:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad831ccb/0x6cf7a864723f6a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936813.056400:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936813.056402:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936813.056406:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936813.061752:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936813.061775:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061801:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1784936813.061816:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936813.061825:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061844:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061857:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061883:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061916:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936813.061941:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.061948:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061968:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.061974:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.061984:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.062008:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.062017:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066df5e37/0x6cf7a864723f6a7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.062048:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.062050:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.062051:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936813.071057:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936813.071094:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.071118:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1784936813.071124:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936813.071132:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.071150:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.071162:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.071171:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.071210:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784936813.073015:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936813.073028:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073046:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1784936813.073051:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936813.073059:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073075:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073094:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073102:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073126:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784936813.073143:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.073151:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073161:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.073166:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073175:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073210:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073219:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338cbc14/0x6cf7a864723f6a86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073257:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.073267:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073274:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.073278:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073286:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073297:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073315:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa5e3e71/0x6cf7a864723f6a8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073330:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.073332:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.073335:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.073344:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936813.073867:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936813.073874:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073885:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1784936813.073889:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936813.073894:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073915:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073925:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073933:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073952:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936813.073963:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.073968:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073975:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.073978:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073987:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.073998:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.074006:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000463ced2c/0x6cf7a864723f6a94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.074030:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.074032:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.074034:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.074706:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.074717:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.074729:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.074733:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.074746:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.074760:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.074771:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.074780:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.075186:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936813.075956:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.075965:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.075978:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.075983:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.075989:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.076002:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.076012:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.076033:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.076704:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.076715:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.076729:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.076735:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.076746:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.076767:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.076775:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6a9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.076856:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784936813.076894:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1784936813.077885:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.077896:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.077912:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.077917:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.077925:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.077940:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.077950:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.077958:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.077975:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784936813.078539:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.078546:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.078562:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.078566:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.078571:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.078582:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.078591:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.078600:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.078609:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1784936813.079293:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.079302:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.079313:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.079318:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.079323:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.079333:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.079353:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.079362:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.079371:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1784936813.080032:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.080039:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.080051:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.080054:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.080059:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.080070:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.080079:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.080088:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.080108:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1784936813.081026:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.081035:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081048:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.081053:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.081058:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081072:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081081:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081090:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081099:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1784936813.081690:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784936813.081703:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.081716:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.081721:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.081741:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.081768:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784936813.081777:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784936813.081777:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4eb601/0x6cf7a864723f6aa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081788:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081798:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.081820:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.081825:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081986:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.081997:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082005:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082016:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784936813.082571:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784936813.082580:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082589:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.082594:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082603:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082616:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082623:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b51502/0x6cf7a864723f6aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082654:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784936813.082660:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082667:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.082671:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082680:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082691:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082699:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d17997/0x6cf7a864723f6ab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082715:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784936813.082720:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082726:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.082730:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082750:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082764:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082772:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb2adef/0x6cf7a864723f6ab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082789:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:2.0:1784936813.082791:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784936813.082793:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082801:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082804:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936813.082825:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1784936813.082827:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082831:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.082841:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082843:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082861:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082865:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082879:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082881:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082898:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.082918:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1784936813.082925:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784936813.082930:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.082938:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.082943:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.083442:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.083451:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.083460:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.083472:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.083481:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784936813.083757:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.083765:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.083775:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.083779:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.083785:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.083796:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.083958:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.083970:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.083981:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784936813.084054:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084072:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084081:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000072e9318/0x6cf7a864723f6ac5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084109:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784936813.084114:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084122:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.084125:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084146:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084158:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084165:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c08efea2/0x6cf7a864723f6ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084178:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936813.084195:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084203:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936813.084206:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084214:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084225:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.084232:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3b496b/0x6cf7a864723f6ada lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.084380:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.084391:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe606a4f/0x6cf7a864723f6acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.084412:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.084415:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.084419:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.084761:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.084768:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.084784:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.084788:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.084794:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.084801:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936813.084818:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.084829:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.084837:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.084864:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936813.084909:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.084914:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.084923:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.084927:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.084937:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.085022:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.085042:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.085062:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.085065:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.085067:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.085141:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.085143:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.085144:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.085493:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.085500:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.085510:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.085514:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.085519:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.085529:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.085690:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.085702:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.085725:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936813.086035:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.086043:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.086052:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.086057:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.086066:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.086079:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.086088:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c617b18/0x6cf7a864723f6ae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.086106:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.086108:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.086109:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.086383:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.086778:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.086792:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.086797:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.086802:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.086824:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.086834:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.086844:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.086922:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936813.087390:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.087397:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.087406:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.087410:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.087415:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.087425:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.087456:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.087464:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087740:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.087750:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087760:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021ec200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.087765:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087775:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087791:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087799:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000778f815/0x6cf7a864723f6aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087833:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.087837:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087844:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021ed000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.087847:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087856:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087879:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.087887:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.087889:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.087891:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936813.087931:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784936813.087937:0:14871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a88f73d4/0x6cf7a864723f6af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.088066:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.088711:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.088719:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.088735:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.088739:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.088745:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.088756:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.088765:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.088772:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.088827:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936813.089229:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.089235:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.089243:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.089246:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.089250:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.089260:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.089279:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.089287:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089386:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.089393:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089402:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021ed800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.089408:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089417:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089458:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089467:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d954b2ca/0x6cf7a864723f6afd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089491:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.089495:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089514:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021edc00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.089518:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089526:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089537:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.089546:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.089548:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.089656:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936813.089728:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784936813.089733:0:14871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a315358f/0x6cf7a864723f6b04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784936813.090225:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.090232:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.090241:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.090245:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.090250:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.090261:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.090271:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.090291:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.090483:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.090490:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.090499:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021ed600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.090504:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.090514:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.090528:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.090542:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.090544:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.090547:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936813.090763:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784936813.090770:0:14871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cad35c7a/0x6cf7a864723f6b0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.090840:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.092455:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.092467:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.092486:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.092492:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.092499:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.092516:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.092528:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.092545:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.092595:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936813.092632:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.092643:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.092655:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021ec400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.092661:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.092673:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.092694:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.092703:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039a2f446/0x6cf7a864723f6b12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.092731:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.092734:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.092737:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.093160:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.093166:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093176:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.093180:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.093185:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093196:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093205:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093213:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093232:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936813.093301:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.093308:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.093330:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9097021eca00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.093335:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.093345:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.093360:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.093369:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044b13ca1/0x6cf7a864723f6b19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.093389:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.093391:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.093393:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936813.093722:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.093728:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093737:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.093745:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.093750:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093761:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093770:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093776:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.093794:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936813.094233:0:14871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936813.094239:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.094248:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1784936813.094251:0:14871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936813.094256:0:14871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.094265:0:14871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.094275:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.094288:0:14871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936813.094310:0:14871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784936813.094396:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936813.094404:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.094415:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4f600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.094420:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.094454:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.094474:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936813.094476:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.094485:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.094488:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092bac010/0x6cf7a864723f6b20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.094510:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4fc00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936813.094514:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.094515:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936813.094519:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936813.094522:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.094529:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.094545:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784936813.094548:0:14871:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:0.0:1784936813.094557:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047cdfcb7/0x6cf7a864723f6b27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936813.094576:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.094578:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936813.094579:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936813.094692:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14255:x1871641524139392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82345us (82613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936813.094704:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784936813.094737:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14255:1871641524139392:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784936813.094760:0:14255:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1784936813.094828:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14255:1871641524139520:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784936813.094868:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936813.094912:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ff927300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936813.095663:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139520 00000100:00100000:0.0:1784936813.095685:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139520 00000100:00100000:0.0:1784936813.095748:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784936813.095758:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14255:x1871641524139520:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784936813.095824:0:14869:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1784936813.109340:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14255:x1871641524139520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13568us (14456us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784936813.109359:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936813.109722:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14255:1871641524139520:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784936813.109744:0:14255:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1784936814.038217:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936815.048563:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936816.073627:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784936816.983467:0:15539:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784936816.983471:0:15539:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1784936816.983615:0:15539:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9096e8586000 00000020:01000004:2.0:1784936816.983631:0:15539:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784936816.983646:0:15539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1784936816.983661:0:15539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9096c9b64d40) 00000020:00000080:2.0:1784936816.983680:0:15539:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784936817.000911:0:15539:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784936817.001183:0:15539:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784936817.002112:0:15539:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784936817.002375:0:15539:0:(osd_scrub.c:137:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784936817.005639:0:15539:0:(osd_scrub.c:916:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784936817.006064:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 537: rc = 0 00100000:10000000:2.0:1784936817.006172:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 537: rc = 0 00100000:10000000:2.0:1784936817.006267:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 537: rc = 0 00100000:10000000:2.0:1784936817.007293:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1784936817.007569:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1784936817.007834:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1784936817.008213:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1784936817.008525:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1784936817.008797:0:15539:0:(osd_scrub.c:1175:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1784936817.009392:0:15539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784936817.009406:0:15539:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784936817.009417:0:15539:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6cf7a864723f6b35 00000020:01000004:2.0:1784936817.009451:0:15539:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784936817.009473:0:15539:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784936817.009476:0:15539:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784936817.009482:0:15539:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784936817.009502:0:15539:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784936817.009506:0:15539:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1784936817.033099:0:15539:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784936817.033137:0:15539:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.101@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1784936817.033142:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784936817.033144:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784936817.033145:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936817.033147:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936817.033148:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936817.033149:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936817.033150:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936817.033152:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936817.033154:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784936817.033157:0:15539:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1784936817.033161:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784936817.033162:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784936817.033163:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936817.033164:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936817.033165:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936817.033166:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936817.033167:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936817.033168:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936817.033169:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784936817.033200:0:15539:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784936817.033220:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524139648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784936817.033295:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936817.033344:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.033471:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139648 00000100:00100000:1.0:1784936817.033480:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139648 00000100:00100000:1.0:1784936817.033529:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784936817.033539:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:15539:x1871641524139648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784936817.033570:0:14227:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784936817.033573:0:14227:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1784936817.033576:0:14227:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784936817.051649:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:15539:x1871641524139648:12345-0@lo:253:mount.lustre.0 Request processed in 18096us (18336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936817.051694:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784936817.051877:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524139648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784936817.051903:0:15539:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784936817.051990:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784936817.051992:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784936817.051993:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784936817.051995:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784936817.051996:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784936817.051998:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784936817.051999:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784936817.052002:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784936817.052004:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784936817.052038:0:15539:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9096e8586000 from lustre-OST0001 10000000:01000000:2.0:1784936817.052081:0:15539:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1784936817.052085:0:15539:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784936817.052096:0:15539:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9096d0c00000 local copy 00010000:00010000:2.0:1784936817.052192:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936817.052546:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524139776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936817.052609:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.052661:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.052826:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139776 00000100:00100000:3.0:1784936817.052836:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139776 00000100:00100000:3.0:1784936817.053092:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784936817.053113:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:15539:x1871641524139776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936817.053502:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:15539:x1871641524139776:12345-0@lo:501:mount.lustre.0 Request processed in 400us (891us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784936817.053520:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784936817.053608:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524139776:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784936817.053628:0:15539:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784936817.053804:0:15539:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784936817.053813:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.053824:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26bc00/0x6cf7a864723f68e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f68e9 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936817.053854:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9096e8586000 10000000:01000000:2.0:1784936817.053860:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784936817.053867:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784936817.053869:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784936817.053875:0:15539:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784936817.053878:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784936817.053924:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.053934:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.053944:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936817.053962:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524139904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784936817.053998:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.054719:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae1300 going to sleep for 11 seconds 00000100:00100000:0.0:1784936817.054876:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524139904 00000100:00100000:0.0:1784936817.054886:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524139904 00000100:00100000:1.0:1784936817.055310:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784936817.055323:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:15539:x1871641524139904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784936817.055341:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936817.055362:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f6b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6b3c expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936817.055407:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f6b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6b3c expref: 17 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936817.055420:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8164a00/0x6cf7a864723f6b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6b3c expref: 17 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936817.055458:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164a00, rc 0) 00000100:00100000:1.0:1784936817.055552:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524139904:12345-0@lo:101:mount.lustre.0 Request processed in 231us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.055559:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784936817.055651:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524139904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784936817.055671:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b43 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.055683:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6b43 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936817.056809:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784936817.058251:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784936817.058977:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784936817.059053:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784936817.059095:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784936817.059225:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784936817.059265:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784936817.059296:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784936817.059370:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784936817.059379:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784936817.059555:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936817.059661:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936817.059803:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0000 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.060055:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140032 00000100:00100000:1.0:1784936817.060067:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140032 00000100:00100000:1.0:1784936817.060141:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784936817.060152:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784936817.060968:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140032:12345-0@lo:501:mount.lustre.0 Request processed in 756us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.060980:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784936817.061138:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff424700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936817.061202:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784936817.061267:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.061307:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae1900 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.061410:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140160 00000100:00100000:1.0:1784936817.061416:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140160 00000100:00100000:1.0:1784936817.061477:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784936817.061485:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936817.062062:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140160:12345-0@lo:503:mount.lustre.0 Request processed in 574us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.062072:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784936817.062258:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784936817.064022:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784936817.064219:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784936817.064312:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936817.064472:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936817.064607:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140288 00000100:00100000:0.0:1784936817.064617:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140288 00000100:00100000:1.0:1784936817.064858:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784936817.064870:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d46a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784936817.065303:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d46a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140288:12345-0@lo:502:mount.lustre.0 Request processed in 433us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.065314:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784936817.065471:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784936817.065851:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784936817.066198:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784936817.066239:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784936817.066298:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784936817.066340:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784936817.066394:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1784936817.066487:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1784936817.066528:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1784936817.066581:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1784936817.066639:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784936817.066716:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936817.067092:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.067267:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140416 00000100:00100000:3.0:1784936817.067277:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140416 00000100:00100000:3.0:1784936817.067328:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784936817.067339:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d46a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784936817.067629:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d46a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140416:12345-0@lo:502:mount.lustre.0 Request processed in 290us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.067638:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784936817.067767:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784936817.067872:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1784936817.067893:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1784936817.070018:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784936817.070036:0:15540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1784936817.070045:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.070048:0:15540:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784936817.070055:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784936817.070075:0:15540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9096fb8db380) 00000020:00000080:0.0:1784936817.070118:0:15540:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784936817.070126:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784936817.070228:0:15540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096e8586000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784936817.070238:0:15540:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784936817.070247:0:15540:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6cf7a864723f6b51 00010000:00010000:1.0:1784936817.076627:0:15540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1784936817.077923:0:15540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1784936817.082382:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1784936817.085335:0:15540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784936817.085354:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936817.085363:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936817.085365:0:15540:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784936817.085370:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936817.085383:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936817.085385:0:15540:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784936817.085389:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784936817.085391:0:15540:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784936817.085394:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936817.085396:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936817.085398:0:15540:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784936817.085400:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784936817.085403:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936817.085404:0:15540:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784936817.085407:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784936817.085565:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784936817.085570:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784936817.085571:0:15540:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784936817.085575:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1784936817.086011:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1784936817.086046:0:15539:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784936817.086068:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b43 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936817.086082:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f000/0x6cf7a864723f6b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b43 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936817.086093:0:15539:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096e8586000 from 1 10000000:01000000:1.0:1784936817.086096:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784936817.086163:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936817.086172:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936817.086187:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936817.086224:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784936817.086323:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936817.086406:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096ffa533c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.087076:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140544 00000100:00100000:3.0:1784936817.087088:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140544 00000100:00100000:3.0:1784936817.087169:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784936817.087181:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d46a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:15539:x1871641524140544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936817.087200:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936817.087218:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6b58 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.087250:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 18 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.087263:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 18 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.087274:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea4400, rc 0) 00000100:00100000:3.0:1784936817.087342:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d46a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140544:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.087371:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784936817.087565:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784936817.087588:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.087599:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936817.088292:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784936817.088841:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784936817.089138:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784936817.089186:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784936817.089317:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784936817.089333:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784936817.089481:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936817.089577:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.089644:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.090065:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140672 00000100:00100000:3.0:1784936817.090076:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140672 00000100:00100000:3.0:1784936817.090155:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784936817.090166:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d46a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936817.090560:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d46a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140672:12345-0@lo:501:mount.lustre.0 Request processed in 394us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.090577:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784936817.091327:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784936817.091457:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784936817.091569:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.091619:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.091708:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140800 00000100:00100000:1.0:1784936817.091740:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140800 00000100:00100000:1.0:1784936817.091780:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784936817.091788:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d46a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936817.092389:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d46a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140800:12345-0@lo:503:mount.lustre.0 Request processed in 599us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.092399:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784936817.092517:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784936817.101001:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784936817.101278:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936817.101414:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.101503:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.105913:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524140928 00000100:00100000:3.0:1784936817.105936:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524140928 00000100:00100000:3.0:1784936817.106018:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784936817.106032:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784936817.106522:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524140928:12345-0@lo:502:mount.lustre.0 Request processed in 491us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.106532:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784936817.106912:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524140928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784936817.108089:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784936817.109514:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784936817.109610:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784936817.109656:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784936817.109694:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00010000:00010000:1.0:1784936817.112298:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784936817.114313:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784936817.114464:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784936817.114507:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1784936817.114588:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936817.117838:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.117937:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.118096:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141056 00000100:00100000:1.0:1784936817.118121:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141056 00000100:00100000:1.0:1784936817.118208:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784936817.118221:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524141056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784936817.118634:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524141056:12345-0@lo:502:mount.lustre.0 Request processed in 415us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.118644:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784936817.119422:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784936817.119688:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784936817.119743:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1784936817.126083:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936817.132081:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.132095:0:15544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784936817.132135:0:15544:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096e8586000 00000020:00000080:0.0:1784936817.132140:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784936817.132177:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936817.132180:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.132182:0:15544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784936817.132184:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936817.132188:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.132190:0:15544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784936817.132193:0:15544:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9096e8586000 00000020:00000080:0.0:1784936817.132195:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784936817.132276:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936817.132278:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.132280:0:15544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784936817.132282:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784936817.132284:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.132285:0:15544:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784936817.132288:0:15544:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9096e8586000 00000020:00000080:0.0:1784936817.132290:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784936817.132404:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784936817.132408:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784936817.132409:0:15544:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784936817.132412:0:15544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1784936817.138070:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784936817.138152:0:15539:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784936817.138186:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.138203:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784936817.138271:0:15539:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784936817.138276:0:15539:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9096e8586000 10000000:01000000:3.0:1784936817.138280:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9096e8586000 10000000:01000000:3.0:1784936817.138286:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784936817.138301:0:15539:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9096e8586000 from 1 10000000:01000000:3.0:1784936817.138305:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784936817.138363:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.138374:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.138389:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936817.138449:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784936817.138557:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936817.138608:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.138642:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141184 00000100:00100000:3.0:1784936817.138651:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141184 00000100:00100000:3.0:1784936817.138712:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784936817.138739:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524141184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784936817.138756:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936817.138774:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f6b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6b66 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.138807:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f6b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6b66 expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.138819:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096d9ea5a00/0x6cf7a864723f6b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6b66 expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936817.138831:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096d9ea5a00, rc 0) 00000100:00100000:3.0:1784936817.140022:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141184:12345-0@lo:101:mount.lustre.0 Request processed in 1292us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.140047:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784936817.141321:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784936817.141366:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b6d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.141382:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6b6d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784936817.146677:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1784936817.151898:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784936817.155290:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1784936817.155466:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1784936817.155512:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1784936817.155571:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1784936817.155618:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1784936817.155680:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1784936817.158635:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1784936817.158791:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1784936817.158884:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1784936817.158927:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1784936817.158987:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1784936817.159045:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1784936817.159087:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1784936817.164419:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1784936817.164654:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1784936817.167845:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1784936817.167963:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1784936817.170418:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1784936817.170694:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1784936817.172093:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1784936817.174326:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1784936817.174456:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1784936817.174504:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1784936817.174561:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1784936817.174624:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1784936817.174658:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1784936817.176828:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1784936817.180237:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1784936817.180311:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1784936817.180457:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1784936817.180496:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1784936817.180525:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1784936817.180654:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1784936817.180699:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1784936817.180737:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1784936817.181528:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1784936817.181572:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1784936817.181680:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1784936817.181687:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1784936817.181853:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936817.181943:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936817.182053:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9377300 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.187519:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141312 00000100:00100000:3.0:1784936817.187542:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141312 00000100:00100000:3.0:1784936817.187628:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784936817.187641:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784936817.188253:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141312:12345-0@lo:501:mount.lustre.0 Request processed in 612us (6307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.188263:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784936817.188345:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784936817.188424:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784936817.188543:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936817.188592:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9377300 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.188675:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141440 00000100:00100000:1.0:1784936817.188682:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141440 00000100:00100000:1.0:1784936817.188719:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784936817.188744:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784936817.189258:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141440:12345-0@lo:503:mount.lustre.0 Request processed in 517us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.189267:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784936817.189359:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784936817.193599:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784936817.194222:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784936817.194342:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936817.196650:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096edbb0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936817.196978:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141568 00000100:00100000:0.0:1784936817.196992:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141568 00000100:00100000:0.0:1784936817.197121:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784936817.197136:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784936817.197800:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141568:12345-0@lo:502:mount.lustre.0 Request processed in 656us (3446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936817.197810:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784936817.199018:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784936817.199516:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784936817.199590:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784936817.199624:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784936817.199684:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784936817.199754:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784936817.199813:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784936817.199852:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784936817.199888:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784936817.199936:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784936817.199973:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784936817.200006:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784936817.200051:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784936817.200087:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784936817.204351:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784936817.204536:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784936817.204582:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784936817.204613:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784936817.204655:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784936817.204685:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784936817.204714:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784936817.204799:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784936817.204842:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784936817.204874:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784936817.204924:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784936817.204961:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1784936817.204993:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1784936817.205044:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1784936817.205080:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1784936817.207369:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1784936817.207546:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1784936817.207588:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1784936817.207625:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1784936817.207677:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1784936817.207738:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1784936817.207778:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1784936817.207831:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1784936817.207893:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1784936817.207930:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1784936817.207982:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1784936817.208020:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1784936817.208099:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784936817.210887:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.210949:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c526f300 going to sleep for 11 seconds 00000100:00100000:1.0:1784936817.211013:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141696 00000100:00100000:1.0:1784936817.211023:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141696 00000100:00100000:1.0:1784936817.211090:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784936817.211168:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784936817.211789:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524141696:12345-0@lo:502:mount.lustre.0 Request processed in 688us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936817.211809:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784936817.220040:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524141696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784936817.220383:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1784936817.220404:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1784936817.224606:0:15548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784936817.224630:0:15548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9096f50999c0) 00000020:00000080:3.0:1784936817.224661:0:15548:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1784936817.224901:0:15548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9096e8586000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784936817.224906:0:15548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9096e8586000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784936817.224909:0:15548:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9096e8586000 3 00010000:00080000:3.0:1784936817.224952:0:15548:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9095c2312800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.101@tcp at head 00010000:00010000:3.0:1784936817.232260:0:15548:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1784936817.232419:0:15548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1784936817.234741:0:15548:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784936817.234769:0:15548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6cf7a864723f6b7b 00000100:00080000:3.0:1784936817.234785:0:15548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784936817.234793:0:15548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9095c2312800 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:3.0:1784936817.234864:0:15548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ff427b80 x1871641524141824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784936817.234897:0:15548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784936817.235204:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524141824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784936817.235300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936817.235512:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141824 00000100:00100000:3.0:1784936817.235523:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141824 00000100:00080000:2.0:1784936817.235680:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784936817.235685:0:11837:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784936817.235688:0:11837:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784936817.235693:0:11837:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:2.0:1784936817.235698:0:11837:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784936817.235703:0:11837:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9096d473e000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:2.0:1784936817.235722:0:11837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096c8a3ca80 x1871641524142080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784936817.235791:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524141952:0@lo:400:kworker.0 00000100:00100000:2.0:1784936817.235839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.235868:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784936817.235874:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524142208:0@lo:400:kworker.0 00000100:00100000:2.0:1784936817.235899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.241882:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524142336:0@lo:400:kworker.0 00000100:00100000:2.0:1784936817.242002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936817.242242:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142208 00000100:00100000:3.0:1784936817.242254:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142208 00000100:00100000:3.0:1784936817.242330:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936817.242343:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524142208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936817.242475:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1871641524142208:12345-0@lo:400:kworker.0 Request processed in 135us (6575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.242484:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936817.242507:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784936817.242512:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1871641524141824:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784936817.242544:0:14232:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1784936817.242593:0:14232:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6cf7a864723f6b82 00000004:00100000:3.0:1784936817.242614:0:14232:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784936817.242677:0:14232:0:(import.c:65:import_set_state_nolock()) ffff9095c3233800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936817.242741:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1871641524141824:12345-0@lo:38:llog_process_th.0 Request processed in 215us (7429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936817.242749:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784936817.242824:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c8a3f100 x1871641524142208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936817.242842:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1871641524142208:0@lo:400:kworker.0 00000040:00080000:3.0:1784936817.243095:0:15548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1784936817.243214:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524142080:0@lo:8:kworker.0 00000100:00100000:0.0:1784936817.243261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784936817.243313:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ff427b80 x1871641524141824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784936827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936817.243323:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784936817.243332:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784936817.243341:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784936817.243347:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784936817.243350:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9095c2312800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784936817.243356:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1871641524141824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784936817.243588:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524141952 00000100:00100000:2.0:1784936817.243594:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524141952 00000100:00100000:2.0:1784936817.243642:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142080 00000100:00100000:2.0:1784936817.243645:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142080 00000100:00100000:2.0:1784936817.243659:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936817.243668:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524141952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936817.243736:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524141952:12345-0@lo:400:kworker.0 Request processed in 60us (7887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936817.243744:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784936817.243762:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784936817.243766:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1871641524142080:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1784936817.243809:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1871641524142080:12345-0@lo:8:kworker.0 Request processed in 41us (548us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784936817.243816:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784936817.243912:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936817.243937:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784936817.243943:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784936817.243947:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784936817.243950:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524142080:0@lo:8:kworker.0 00000100:00100000:0.0:1784936817.243969:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142336 00000100:00100000:0.0:1784936817.243974:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142336 00000100:00100000:0.0:1784936817.244015:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784936817.244023:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524142336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936817.244063:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524142336:12345-0@lo:400:kworker.0 Request processed in 41us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936817.244069:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784936817.244099:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096c8a3d880 x1871641524142336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936817.244198:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524142336:0@lo:400:kworker.0 00000100:00080000:2.0:1784936817.244249:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936817.245271:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524141952:0@lo:400:kworker.0 00000020:01000000:0.0:1784936817.248583:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784936817.248649:0:15539:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784936817.248737:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b6d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.248751:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096d9ea4200/0x6cf7a864723f6b66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b6d expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784936817.248846:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784936817.248849:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784936817.248850:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936817.248851:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936817.248852:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936817.248853:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936817.248855:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936817.248857:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936817.248858:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936817.248864:0:15539:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1784936817.248867:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784936817.248868:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784936817.248869:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784936817.248870:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784936817.248871:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784936817.248872:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784936817.248873:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784936817.248874:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784936817.248875:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784936817.248933:0:15539:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784936817.248963:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524142464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784936817.249057:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936817.249213:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936817.251785:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142464 00000100:00100000:3.0:1784936817.251820:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142464 00000100:00100000:3.0:1784936817.252942:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784936817.252959:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:15539:x1871641524142464:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784936817.253009:0:14226:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784936817.253030:0:14226:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784936817.287876:0:14226:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784936817.287937:0:14226:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784936817.288028:0:14248:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784936817.288035:0:14248:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784936817.288065:0:14248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.288087:0:14248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.288097:0:14248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.288222:0:14248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.288244:0:14248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 19 pid: 14225 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936817.288265:0:14248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14248:1871641524142592:0@lo:104: 00000100:00100000:0.0:1784936817.288359:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936817.288483:0:14248:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c73819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936817.291774:0:14217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142592 00000100:00100000:2.0:1784936817.291793:0:14217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142592 00000100:00100000:2.0:1784936817.291863:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936817.291876:0:14217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14248:x1871641524142592:12345-0@lo:104: 00010000:00010000:2.0:1784936817.291900:0:14217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292388:0:14217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784936817.292397:0:14217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:14248:x1871641524142592:12345-0@lo:104: Request processed in 523us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936817.292406:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784936817.292476:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936817.292485:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292495:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:2.0:1784936817.292501:0:15351:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292513:0:15351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784936817.292525:0:15351:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784936817.292533:0:15351:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784936817.292602:0:15351:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292611:0:15351:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784936817.292649:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292660:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096f4d18600/0x6cf7a864723f6a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6a63 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292687:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936817.292689:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936817.292691:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936817.292713:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524142720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784936817.292775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936817.292853:0:14220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142720 00000100:00100000:2.0:1784936817.292859:0:14220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142720 00010000:00010000:2.0:1784936817.292886:0:14220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 20 pid: 14225 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936817.292918:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784936817.292930:0:14220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+20:3306:x1871641524142720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936817.292949:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936817.292958:0:14220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 20 pid: 14225 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.292976:0:14220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 20 pid: 14225 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293000:0:14220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293009:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784936817.293027:0:14220:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004993695s 00010000:00010000:2.0:1784936817.293033:0:14220:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293041:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293049:0:14220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293054:0:14220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293074:0:14220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936817.293079:0:14220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293086:0:14220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293095:0:14220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.293234:0:14248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26ba00/0x6cf7a864723f6a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f6a5c expref: 20 pid: 14225 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936817.293249:0:14248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14248:1871641524142592:0@lo:104: 00010000:00010000:0.0:1784936817.293275:0:14248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.293285:0:14248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936817.293292:0:14248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293346:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26b400/0x6cf7a864723f6b89 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936817.293360:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936817.293409:0:14220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3306:x1871641524142720:12345-0@lo:103:ldlm_bl.0 Request processed in 482us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936817.293417:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784936817.293576:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524142720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784936817.297723:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:15539:x1871641524142464:12345-0@lo:253:mount.lustre.0 Request processed in 44752us (48648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936817.297753:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784936817.297899:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8567782c-cd42-40bd-85ed-bd4db0d07a3f:15539:1871641524142464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784936817.297919:0:15539:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784936817.297923:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784936817.297926:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784936817.297927:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784936817.297928:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784936817.297930:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784936817.297931:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784936817.297933:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784936817.297935:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784936817.297937:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784936817.297962:0:15539:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784936817.303701:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936817.303897:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784936817.304180:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936817.304342:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784936817.304537:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784936817.304784:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784936817.305851:0:15539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784936817.378294:0:15539:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784936817.378305:0:15539:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784936817.378349:0:15539:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784936817.378561:0:15539:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784936817.378584:0:15539:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784936817.378624:0:15539:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:2.0:1784936817.723500:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1784936817.723606:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784936818.056874:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524142848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936818.056971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936818.057184:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142848 00000100:00100000:1.0:1784936818.057195:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142848 00000100:00100000:1.0:1784936818.057263:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784936818.057273:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524142848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936818.057320:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936818.057390:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524142848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936818.057404:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936818.057577:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784936818.057671:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524142848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936818.121536:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784936818.505537:0:14230:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784936818.505545:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9096ff4ed800 from 8 10000000:01000000:2.0:1784936818.505566:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784936818.505613:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936818.505626:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936818.505637:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936818.505664:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524142976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936818.505747:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936818.505867:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936818.505992:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524142976 00000100:00100000:1.0:1784936818.506000:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524142976 00000100:00100000:1.0:1784936818.506071:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784936818.506230:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524142976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936818.506247:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936818.506265:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8165400/0x6cf7a864723f6b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6b90 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936818.506287:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8165400/0x6cf7a864723f6b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6b90 expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936818.506297:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8165400/0x6cf7a864723f6b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6b90 expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936818.506306:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165400, rc 0) 00000100:00100000:1.0:1784936818.506367:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524142976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936818.506384:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784936818.506625:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524142976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936818.506643:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b97 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936818.506654:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6b97 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936818.506728:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524143104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784936818.506921:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936818.507006:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784936818.510944:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143104 00000100:00100000:0.0:1784936818.510959:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143104 00000100:00100000:0.0:1784936818.512378:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784936818.512392:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524143104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784936818.512420:0:14226:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784936818.512455:0:14226:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784936818.512459:0:14226:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1784936818.512579:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524143104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (5658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936818.512587:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784936818.513255:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524143104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784936818.513319:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784936818.513329:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b97 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936818.513351:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f7f4ec00/0x6cf7a864723f6b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6b97 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936819.144687:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936820.171563:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784936820.492272:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784936821.193697:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.216769:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784936822.666601:0:11837:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784936822.666609:0:11837:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784936822.666614:0:11837:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784936822.666642:0:11837:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9096d473e000 using connection 192.168.204.101@tcp/0@lo 00000100:00100000:0.0:1784936822.666686:0:11837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9096ede55c00 x1871641524143488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784936822.666740:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524143744:0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.666810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936822.666869:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784936822.666876:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524143232:0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.666903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936822.666922:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524143872:0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.666958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936822.666982:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524143616:0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.667005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936822.667022:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784936822.667028:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524143360:0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.667050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936822.667073:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524143488:0@lo:8:kworker.0 00000100:00100000:0.0:1784936822.667094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936822.667121:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143744 00000100:00100000:0.0:1784936822.667126:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143744 00000100:00100000:0.0:1784936822.667165:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143872 00000100:00100000:0.0:1784936822.667167:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143872 00000100:00100000:0.0:1784936822.667177:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143616 00000100:00100000:0.0:1784936822.667179:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143616 00000100:00100000:0.0:1784936822.667192:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784936822.667199:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.667242:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524143744:12345-0@lo:400:kworker.0 Request processed in 43us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936822.667259:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784936822.667274:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936822.667279:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.667303:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524143872:12345-0@lo:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936822.667309:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784936822.667317:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936822.667322:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524143616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.667345:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1871641524143616:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936822.667351:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784936822.667374:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143360 00000100:00100000:0.0:1784936822.667377:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143360 00000100:00100000:0.0:1784936822.667398:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143488 00000100:00100000:0.0:1784936822.667400:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143488 00000100:00100000:0.0:1784936822.667409:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936822.667414:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936822.667462:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524143360:12345-0@lo:400:kworker.0 Request processed in 48us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936822.667468:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936822.667478:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936822.667482:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1871641524143488:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784936822.667504:0:14869:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:0.0:1784936822.667532:0:14869:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6cf7a864723f6b9e 00002000:00100000:0.0:1784936822.667547:0:14869:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9096ef4b9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cf ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784936822.667557:0:14869:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784936822.667560:0:14869:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784936822.667901:0:14869:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784936822.667926:0:14869:0:(import.c:65:import_set_state_nolock()) ffff9096ef4bf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936822.667967:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1871641524143488:12345-0@lo:8:kworker.0 Request processed in 483us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936822.667973:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784936822.668008:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede55c00 x1871641524143488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784936847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784936822.668024:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784936822.668031:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784936822.668036:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784936822.668038:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9096d473e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784936822.668058:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784936822.668063:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1871641524143488:0@lo:8:kworker.0 00000004:00080000:0.0:1784936822.668085:0:14256:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784936822.668460:0:14256:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 488420031063ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784936822.668492:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524143360:0@lo:400:kworker.0 00010000:00080000:0.0:1784936822.668504:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede55180 x1871641524143616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936822.668513:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1871641524143616:0@lo:400:kworker.0 00010000:00080000:0.0:1784936822.668538:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede55500 x1871641524143872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936822.668546:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524143872:0@lo:400:kworker.0 00010000:00080000:0.0:1784936822.668556:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ede56300 x1871641524143744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784936838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784936822.668572:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524143744:0@lo:400:kworker.0 00000100:00100000:1.0:1784936822.668854:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524143232 00000100:00100000:1.0:1784936822.668860:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524143232 00000100:00100000:1.0:1784936822.668905:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784936822.668912:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3307:x1871641524143232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936822.668987:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3307:x1871641524143232:12345-0@lo:400:kworker.0 Request processed in 75us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936822.668994:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784936822.669032:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524143232:0@lo:400:kworker.0 00000100:00080000:2.0:1784936822.669261:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936822.669267:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1784936822.673718:0:14257:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1784936822.673751:0:14257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14257:1871641524144128:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784936822.673883:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936822.673918:0:14257:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c814ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1784936822.674095:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784936822.674109:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524144000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936822.674135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936822.674175:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144128 00000100:00100000:3.0:1784936822.674182:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144128 00000100:00100000:3.0:1784936822.674230:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784936822.674238:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14257:x1871641524144128:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1784936822.675342:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784936822.675536:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144000 00000100:00100000:1.0:1784936822.675545:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144000 00000100:00100000:1.0:1784936822.675593:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784936822.675601:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524144000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784936822.675642:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936822.675723:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1871641524144000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936822.675731:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784936822.680086:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9096ff425f80 x1871641524144000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784936838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784936822.680114:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524144000:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1784936822.680295:0:14869:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784936822.680302:0:14869:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1784936822.680307:0:14869:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1784936822.692399:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.692418:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692476:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.692483:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.692492:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692517:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692532:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692542:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692587:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936822.692606:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936822.692613:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692632:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.692638:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692649:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692671:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.692679:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6ba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.693653:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.693660:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.693663:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.697478:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.697502:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.697524:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.697539:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.697548:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.697567:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.697581:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.697590:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.697617:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936822.698148:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936822.698163:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.698178:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.698184:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.698214:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.698243:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.698252:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066df5e37/0x6cf7a864723f6bac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.698283:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.698285:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.698287:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.699404:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.699417:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699462:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.699468:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.699476:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699493:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699506:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699525:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699553:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936822.699573:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936822.699581:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699593:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.699600:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699611:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699641:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699650:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095bf6387/0x6cf7a864723f6bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.699675:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.699677:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.699679:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784936822.700921:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1784936822.702008:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.702035:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.702056:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.702062:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.702070:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.702089:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.702102:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.702111:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.702214:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.702269:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.702282:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.702298:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea5c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.702303:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.702316:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.702347:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.702356:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7deb126/0x6cf7a864723f6bba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.702384:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.702386:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.702388:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.704498:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.704514:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.704533:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.704540:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.704547:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.704564:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.704585:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.704594:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.704622:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936822.704653:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936822.704667:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.704681:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.704687:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.704699:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.704718:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.704741:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad831ccb/0x6cf7a864723f6bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.704767:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.704768:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.704770:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.712613:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.712640:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.712664:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.712671:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.712679:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.712699:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.712712:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.712721:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.712767:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936822.712799:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936822.712817:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.712832:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d9ea4c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.712839:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.712852:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.712882:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.712891:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014be7fbb/0x6cf7a864723f6bc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.712927:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.712929:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.712932:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.715785:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.715814:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.715835:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.715841:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.715849:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.715869:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.715882:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.715893:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.715924:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.715959:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.715977:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.716014:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.716021:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.716035:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.716060:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.716068:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0c23589/0x6cf7a864723f6bcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.716102:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.716105:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.716111:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.718035:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.718050:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.718069:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.718083:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.718090:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.718107:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.718131:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.718141:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.718173:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.718264:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.718277:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.718291:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.718298:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.718309:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.718344:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.718354:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c617b18/0x6cf7a864723f6bd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.718387:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.718390:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.718396:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.719040:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.719048:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.719060:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.719064:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.719069:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.719082:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.719092:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.719108:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.719203:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.719261:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.719271:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.719283:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.719290:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.719301:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.719319:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.719328:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ee4d9f/0x6cf7a864723f6bdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.719378:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.719381:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.719383:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.720084:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.720093:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.720106:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.720110:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.720344:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.720363:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.720373:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.720382:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.720407:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.720470:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.720481:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.720494:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.720498:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.720508:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.720522:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.720530:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe606a4f/0x6cf7a864723f6be4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.720553:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.720555:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.720556:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.721760:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.721772:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.721864:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.721871:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.721878:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.721895:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.721906:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.721916:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.721944:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.721971:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.721982:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.722024:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.722029:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.722040:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.722059:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.722068:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3b496b/0x6cf7a864723f6beb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.722104:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.722108:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.722110:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.723066:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.723076:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.723088:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.723093:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.723098:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.723111:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.723270:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.723279:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.723306:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.723339:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.723350:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.723363:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.723367:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.723377:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.723408:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.723417:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c08efea2/0x6cf7a864723f6bf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.723465:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.723467:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.723470:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.728123:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.728146:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728169:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.728176:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.728184:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728204:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728218:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728229:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728291:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936822.728324:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936822.728333:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728343:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.728349:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728360:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728385:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728394:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000072e9318/0x6cf7a864723f6bf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.728492:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.728496:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.728503:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.730511:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.730667:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.730755:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.730773:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.730782:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.730866:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.730880:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.730890:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.730927:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784936822.731119:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936822.731136:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.731151:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18a00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936822.731157:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.731171:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.731201:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.731209:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4cc0aa9/0x6cf7a864723f6c00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.731246:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.731249:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.731255:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.732114:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.732312:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.732326:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.732331:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.732337:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.732351:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.732361:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.732379:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.732409:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936822.732491:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936822.732503:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.732516:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.732522:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.732534:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.732551:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.732559:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb2adef/0x6cf7a864723f6c07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.732587:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.732589:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.732591:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.736488:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.736514:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.736550:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.736556:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.736564:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.736585:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.736610:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.736620:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.736666:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784936822.736692:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936822.736707:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.736722:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936822.736728:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.736740:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.736768:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.736776:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d17997/0x6cf7a864723f6c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.736830:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.736835:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.736839:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.737368:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.737376:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.737397:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.737401:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.737406:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.737418:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.737465:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.737474:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.737492:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784936822.737578:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936822.737589:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.737600:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18c00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936822.737606:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.737648:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.737664:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.737673:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054b51502/0x6cf7a864723f6c15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.737720:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.737722:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.737726:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.738044:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.738066:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.738076:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.738079:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.738084:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.738096:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.738118:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.738127:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.738151:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784936822.738185:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936822.738196:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.738206:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d18200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.738212:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.738236:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.738251:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.738259:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c4eb601/0x6cf7a864723f6c1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.738285:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.738290:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.738298:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.741392:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.741411:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.741451:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.741458:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.741467:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.741484:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.741496:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.741506:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.741567:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784936822.741593:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784936822.741607:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.741639:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19e00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936822.741647:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.741659:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.741681:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.741689:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e15ea0f1/0x6cf7a864723f6c23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936822.741730:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.741732:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784936822.741734:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.745196:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.745216:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.745240:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.745246:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.745254:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.745272:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.745286:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.745296:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.745331:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784936822.746198:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936822.746216:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.746233:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165b600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936822.746239:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.746250:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.746274:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.746295:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081932854/0x6cf7a864723f6c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.746331:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.746333:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.746335:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784936822.746567:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784936822.746578:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.746600:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1784936822.746615:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936822.746630:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.746645:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.746656:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.746663:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.754243:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936822.754260:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.754276:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165a400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.754283:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784936822.754283:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.754307:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.754334:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.754342:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000151608ea/0x6cf7a864723f6c31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.754378:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.754380:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.754382:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936822.755399:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.755407:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.755421:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.755491:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.755499:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.755513:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.755524:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.755532:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.755588:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936822.756161:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.756168:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.756177:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.756180:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.756184:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.756204:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.756214:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.756221:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.758363:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784936822.759146:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759165:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4fe00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.759171:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759184:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759207:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759231:0:15351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6e1ecc3/0x6cf7a864723f6c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759263:0:15351:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936822.759268:0:15351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759274:0:15351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4f400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:1.0:1784936822.759278:0:15351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759286:0:15351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759297:0:15351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.759502:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.759506:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.759508:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936822.759638:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784936822.759646:0:14869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8b4247/0x6cf7a864723f6c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784936822.760690:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.760699:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.760713:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.760718:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.760725:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.760740:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.760764:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.760773:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.760799:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784936822.760917:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936822.760932:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.760947:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4ee00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.760954:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.760966:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.760990:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.761012:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bbc0d5e/0x6cf7a864723f6c46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.761038:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.761040:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.761042:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936822.761532:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936822.762210:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.762218:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762234:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.762239:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.762244:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762257:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762267:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762275:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762316:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936822.762871:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.762876:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762882:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.762885:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.762888:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762894:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762899:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762903:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.762929:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784936822.762949:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936822.762962:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.762974:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4f200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.762979:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.762988:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763007:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763013:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444275a4/0x6cf7a864723f6c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763041:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936822.763044:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763065:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e000 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.763069:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763077:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763088:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763096:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009225ab30/0x6cf7a864723f6c54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.763117:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.763119:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.763121:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784936822.763809:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.763818:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.763828:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.763838:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.763844:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.763855:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.763864:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.763871:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.763887:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784936822.764825:0:14869:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784936822.764833:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.764843:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1784936822.764847:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936822.764851:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.764861:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.764868:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.764880:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936822.764905:0:14869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784936822.764920:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784936822.764932:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.764944:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e600 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.764950:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.764962:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.764995:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.765003:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309b192c/0x6cf7a864723f6c5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.765034:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784936822.765038:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784936822.765170:0:14869:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:1.0:1784936822.765178:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.765196:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e800 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936822.765201:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936822.765204:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.765216:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.765233:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.765242:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea291771/0x6cf7a864723f6c62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936822.765270:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.765273:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936822.765282:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936822.765289:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14257:x1871641524144128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 91046us (91400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936822.765302:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784936822.765522:0:14257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14257:1871641524144128:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784936822.765542:0:14257:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1784936822.765695:0:14257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14257:1871641524144256:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784936822.765737:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936822.765826:0:14257:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c8ae13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784936822.765859:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144256 00000100:00100000:2.0:1784936822.765866:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144256 00000100:00100000:2.0:1784936822.765994:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936822.766004:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14257:x1871641524144256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784936822.766046:0:14871:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1784936822.772332:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14257:x1871641524144256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6321us (6586us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784936822.772348:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784936822.772733:0:14257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14257:1871641524144256:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784936822.772750:0:14257:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1784936823.178028:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936823.178051:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524144384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936823.178116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936823.178211:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144384 00000100:00100000:1.0:1784936823.178218:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144384 00000100:00100000:1.0:1784936823.178274:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784936823.178282:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524144384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784936823.178320:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936823.178498:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524144384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936823.178506:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784936823.178552:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524144384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784936823.248032:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784936823.820137:0:15894:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784936824.265115:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784936825.288619:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936825.681150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936825.681253:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503179648 00000100:00100000:0.0:1784936825.681264:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503179648 00000100:00100000:0.0:1784936825.681311:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:0.0:1784936825.681320:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2370:x1871641503179648:12345-192.168.204.1@tcp:250:mount.lustre.0 00010000:00080000:0.0:1784936825.681349:0:14226:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 01ea0ce2-4f07-4ea4-ac68-d123b6a2291c@192.168.204.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1784936825.681379:0:14226:0:(genops.c:1406:class_connect()) connect: client 01ea0ce2-4f07-4ea4-ac68-d123b6a2291c, cookie 0x6cf7a864723f6c69 00000100:00080000:0.0:1784936825.682129:0:14226:0:(import.c:65:import_set_state_nolock()) ffff9096ef4bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784936825.682204:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+5:2370:x1871641503179648:12345-192.168.204.1@tcp:250:mount.lustre.0 Request processed in 883us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936825.682213:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 75 00000100:00100000:0.0:1784936825.695867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.696046:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503179776 00000100:00100000:1.0:1784936825.696057:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503179776 00000100:00100000:1.0:1784936825.696121:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:1.0:1784936825.696130:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c70dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+5:13737:x1871641503179776:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784936825.696147:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936825.696162:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8164000/0x6cf7a864723f6c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c950ba expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936825.696197:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164000/0x6cf7a864723f6c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950ba expref: 6 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936825.696205:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8164000/0x6cf7a864723f6c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950ba expref: 6 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936825.696211:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164000, rc 0) 00000100:00100000:1.0:1784936825.696260:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c70dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+6:13737:x1871641503179776:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 130us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936825.696266:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 76 00000100:00100000:1.0:1784936825.697826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936825.697966:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503179904 00000100:00100000:0.0:1784936825.697976:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503179904 00000100:00100000:0.0:1784936825.698166:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:0.0:1784936825.698175:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+6:13737:x1871641503179904:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784936825.698471:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+6:13737:x1871641503179904:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 295us (649us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784936825.698481:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 77 00000100:00100000:0.0:1784936825.701746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936825.702091:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180032 00000100:00100000:2.0:1784936825.702103:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180032 00000100:00100000:2.0:1784936825.702166:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:2.0:1784936825.702176:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+6:13737:x1871641503180032:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784936825.702193:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936825.702213:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f7f4f800/0x6cf7a864723f6c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c950c1 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936825.702245:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f7f4f800/0x6cf7a864723f6c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950c1 expref: 7 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936825.702273:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f7f4f800/0x6cf7a864723f6c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950c1 expref: 7 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936825.702283:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4f800, rc 0) 00000100:00100000:2.0:1784936825.702511:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+7:13737:x1871641503180032:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 335us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936825.702517:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 78 00000100:00100000:2.0:1784936825.710932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936825.711066:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180160 00000100:00100000:0.0:1784936825.711078:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180160 00000100:00100000:0.0:1784936825.711141:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:0.0:1784936825.711165:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+7:13737:x1871641503180160:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784936825.712482:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13737:x1871641503180160:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 1312us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936825.712504:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 79 00000100:00100000:1.0:1784936825.716965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936825.717098:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180288 00000100:00100000:2.0:1784936825.717108:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180288 00000100:00100000:2.0:1784936825.718668:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:2.0:1784936825.718687:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13737:x1871641503180288:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784936825.718951:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13737:x1871641503180288:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 270us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936825.718959:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 80 00000100:00100000:2.0:1784936825.731675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.731839:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180416 00000100:00100000:1.0:1784936825.731850:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180416 00000100:00100000:1.0:1784936825.731910:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:1.0:1784936825.731921:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13756:x1871641503180416:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784936825.732248:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13756:x1871641503180416:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 328us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936825.732256:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 81 00000100:00100000:0.0:1784936825.761191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936825.761485:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180544 00000100:00100000:2.0:1784936825.761495:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180544 00000100:00100000:2.0:1784936825.761552:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:2.0:1784936825.761562:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13756:x1871641503180544:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784936825.762165:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13756:x1871641503180544:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 602us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936825.762174:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 82 00000100:00100000:2.0:1784936825.765688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936825.765818:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180672 00000100:00100000:3.0:1784936825.765830:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180672 00000100:00100000:3.0:1784936825.765890:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:3.0:1784936825.765900:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+8:13737:x1871641503180672:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784936825.765920:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936825.765939:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165a200/0x6cf7a864723f6c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c950eb expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936825.765975:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165a200/0x6cf7a864723f6c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950eb expref: 9 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936825.765998:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165a200/0x6cf7a864723f6c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950eb expref: 9 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936825.766008:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165a200, rc 0) 00000100:00100000:3.0:1784936825.766070:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+9:13737:x1871641503180672:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 171us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936825.766077:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 83 00000100:00100000:0.0:1784936825.771899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.772150:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180800 00000100:00100000:1.0:1784936825.772164:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180800 00000100:00100000:1.0:1784936825.772221:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:1.0:1784936825.772231:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+9:13737:x1871641503180800:12345-192.168.204.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784936825.772256:0:14227:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784936825.772279:0:14227:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784936825.772288:0:14227:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784936825.772291:0:14227:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784936825.772293:0:14227:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1784936825.774587:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+9:13737:x1871641503180800:12345-192.168.204.1@tcp:256:mount.lustre.0 Request processed in 2337us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936825.774603:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 84 00000100:00100000:2.0:1784936825.783348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.784336:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503180928 00000100:00100000:1.0:1784936825.784349:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503180928 00000100:00100000:1.0:1784936825.784410:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:1.0:1784936825.784420:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+9:13737:x1871641503180928:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784936825.784476:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936825.784495:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c950f2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936825.784526:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 10 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936825.784538:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 10 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936825.784548:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164800, rc 0) 00000100:00100000:1.0:1784936825.784612:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13737:x1871641503180928:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 193us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936825.784620:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 85 00000100:00100000:0.0:1784936825.788967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.789530:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181056 00000100:00100000:1.0:1784936825.789540:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181056 00000100:00100000:1.0:1784936825.789611:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:1.0:1784936825.789621:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13737:x1871641503181056:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784936825.790221:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13737:x1871641503181056:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 598us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936825.790231:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 86 00000100:00100000:0.0:1784936825.804065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936825.804151:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181184 00000100:00100000:3.0:1784936825.804162:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181184 00000100:00100000:3.0:1784936825.804221:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:3.0:1784936825.804231:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13737:x1871641503181184:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784936825.804543:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13737:x1871641503181184:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 313us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936825.804561:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 87 00000100:00100000:2.0:1784936825.807997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.808319:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181312 00000100:00100000:1.0:1784936825.808330:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181312 00000100:00100000:1.0:1784936825.808386:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:1.0:1784936825.808396:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13762:x1871641503181312:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784936825.808789:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13762:x1871641503181312:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 392us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936825.808798:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 88 00000100:00100000:0.0:1784936825.812699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936825.812797:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181440 00000100:00100000:2.0:1784936825.812806:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181440 00000100:00100000:2.0:1784936825.812865:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 89 00000100:00100000:2.0:1784936825.812876:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13762:x1871641503181440:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784936825.813134:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13762:x1871641503181440:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 258us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936825.813142:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 89 00000100:00100000:0.0:1784936825.844739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936825.844865:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181568 00000100:00100000:2.0:1784936825.844876:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181568 00000100:00100000:2.0:1784936825.844927:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1784936825.844935:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2370:x1871641503181568:12345-192.168.204.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784936825.844964:0:14234:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 72410603-668c-4b8f-a839-7098c5dcbd21@192.168.204.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1784936825.845038:0:14234:0:(genops.c:1406:class_connect()) connect: client 72410603-668c-4b8f-a839-7098c5dcbd21, cookie 0x6cf7a864723f6c8c 00000004:00100000:2.0:1784936825.845069:0:14234:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784936825.845075:0:14234:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1784936825.940106:0:14234:0:(import.c:65:import_set_state_nolock()) ffff9096f50a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784936825.940206:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+6:2370:x1871641503181568:12345-192.168.204.1@tcp:38:mount.lustre.0 Request processed in 95268us (95473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936825.940217:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:1.0:1784936825.944893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936825.945021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936825.945479:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181696 00000100:00100000:0.0:1784936825.945490:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181696 00000100:00100000:2.0:1784936825.945529:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181824 00000100:00100000:2.0:1784936825.945535:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181824 00000100:00100000:0.0:1784936825.945576:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00080000:1.0:1784936825.945617:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784936825.945653:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+7:0:x1871641503181696:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784936825.945697:0:14233:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784936825.945785:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+7:0:x1871641503181696:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 135us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936825.950596:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1784936825.950822:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1784936825.950841:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+6:13737:x1871641503181824:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784936825.952249:0:14234:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784936825.952351:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+6:13737:x1871641503181824:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 1516us (7326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936825.952360:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936825.957797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936825.957874:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503181952 00000100:00100000:2.0:1784936825.957884:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503181952 00000100:00100000:2.0:1784936825.957958:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1784936825.957969:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:13737:x1871641503181952:12345-192.168.204.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784936825.958081:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:13737:x1871641503181952:12345-192.168.204.1@tcp:40:mount.lustre.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936825.958089:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1784936825.961469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936825.961516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936825.961539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936825.961721:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182080 00000100:00100000:3.0:1784936825.961731:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182080 00000100:00100000:3.0:1784936825.961777:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182208 00000100:00100000:3.0:1784936825.961780:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182208 00000100:00100000:3.0:1784936825.961796:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1784936825.961805:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1871641503182080:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784936825.961839:0:14868:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 72410603-668c-4b8f-a839-7098c5dcbd21@192.168.204.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:3.0:1784936825.961868:0:14868:0:(genops.c:1406:class_connect()) connect: client 72410603-668c-4b8f-a839-7098c5dcbd21, cookie 0x6cf7a864723f6c93 00002000:00100000:3.0:1784936825.961879:0:14868:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 72410603-668c-4b8f-a839-7098c5dcbd21/ffff9095c3231000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784936825.961904:0:14868:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784936825.962158:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182336 00000100:00100000:1.0:1784936825.962164:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182336 00000100:00100000:1.0:1784936825.962204:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:1.0:1784936825.962211:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:13737:x1871641503182336:12345-192.168.204.1@tcp:33:mount.lustre.0 00002000:00080000:3.0:1784936825.962612:0:14868:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784936825.962642:0:14868:0:(import.c:65:import_set_state_nolock()) ffff9095c3231800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936825.962859:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:2370:x1871641503182080:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 1053us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936825.962867:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:3.0:1784936825.963235:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936825.963242:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1871641503182208:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784936825.963272:0:14868:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 72410603-668c-4b8f-a839-7098c5dcbd21@192.168.204.1@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:3.0:1784936825.963295:0:14868:0:(genops.c:1406:class_connect()) connect: client 72410603-668c-4b8f-a839-7098c5dcbd21, cookie 0x6cf7a864723f6c9a 00002000:00100000:3.0:1784936825.963303:0:14868:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 72410603-668c-4b8f-a839-7098c5dcbd21/ffff9095c3232800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784936825.963323:0:14868:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784936825.963527:0:14868:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784936825.963550:0:14868:0:(import.c:65:import_set_state_nolock()) ffff9095c3237000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936825.963596:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:2370:x1871641503182208:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 353us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936825.963603:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000004:00080000:2.0:1784936825.964296:0:14235:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2013us 00000004:00200000:1.0:1784936826.004134:0:14235:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1784936826.004342:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:13737:x1871641503182336:12345-192.168.204.1@tcp:33:mount.lustre.0 Request processed in 42125us (42820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936826.004353:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1784936826.204659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936826.204791:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182464 00000100:00100000:1.0:1784936826.204804:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182464 00000100:00100000:1.0:1784936826.204874:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1784936826.204886:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+6:13783:x1871641503182464:12345-192.168.204.1@tcp:101:mkdir.0 00010000:00010000:1.0:1784936826.204934:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936826.204977:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6ca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9511c expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936826.205073:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ca8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936826.205092:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936826.205108:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936826.205315:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784936826.205318:0:14233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936826.205388:0:14233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936826.205413:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9511c expref: 8 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936826.205475:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9511c expref: 7 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936826.205489:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:1.0:1784936826.205504:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784936826.205509:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:1.0:1784936826.205601:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+7:13783:x1871641503182464:12345-192.168.204.1@tcp:101:mkdir.0 Request processed in 716us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936826.205608:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:1.0:1784936826.312637:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936827.337594:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936827.784818:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524144512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936827.784892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936827.784982:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144512 00000100:00100000:3.0:1784936827.784989:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144512 00000100:00100000:3.0:1784936827.785045:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784936827.785055:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524144512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936827.785097:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936827.785144:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1871641524144512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936827.785152:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1784936827.785173:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936827.785208:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524144512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936827.785513:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524144768:0@lo:400:kworker.0 00000100:00100000:1.0:1784936827.785556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936827.785602:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784936827.785607:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524144896:0@lo:400:kworker.0 00000100:00100000:1.0:1784936827.785634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936827.785747:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144896 00000100:00100000:3.0:1784936827.785751:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144896 00000100:00100000:3.0:1784936827.785786:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784936827.785793:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524144896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.785851:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524144896:12345-0@lo:400:kworker.0 Request processed in 57us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936827.785858:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784936827.785876:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524145024:0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.785907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936827.785923:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784936827.785928:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524144640:0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.785953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936827.785975:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096d4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524145152:0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.785999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936827.786022:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144640 00000100:00100000:3.0:1784936827.786026:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144640 00000100:00100000:3.0:1784936827.786051:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784936827.786057:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edd09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3307:x1871641524144640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.786090:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edd09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3307:x1871641524144640:12345-0@lo:400:kworker.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936827.786096:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784936827.786125:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145024 00000100:00100000:3.0:1784936827.786129:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145024 00000100:00100000:3.0:1784936827.786150:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145152 00000100:00100000:3.0:1784936827.786153:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145152 00000100:00100000:3.0:1784936827.786166:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936827.786172:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524145024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.786198:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1871641524145024:12345-0@lo:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936827.786204:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784936827.786222:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784936827.786228:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524145152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.786255:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1871641524145152:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936827.786261:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1784936827.786275:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936827.786291:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524144640:0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.786302:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1871641524145152:0@lo:400:kworker.0 00000100:00100000:3.0:1784936827.786311:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1871641524145024:0@lo:400:kworker.0 00000100:00100000:0.0:1784936827.786461:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524144896:0@lo:400:kworker.0 00000100:00100000:2.0:1784936827.786621:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524144768 00000100:00100000:2.0:1784936827.786625:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524144768 00000100:00100000:2.0:1784936827.786664:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784936827.786671:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524144768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936827.786714:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524144768:12345-0@lo:400:kworker.0 Request processed in 44us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936827.786720:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1784936827.788253:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936827.788305:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096d4665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524144768:0@lo:400:kworker.0 00000001:00100000:1.0:1784936827.818113:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72410603-668c-4b8f-a839-7098c5dcbd21 00000001:00100000:3.0:1784936827.861762:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784936827.862227:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1784936827.862355:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72410603-668c-4b8f-a839-7098c5dcbd21 00000100:00100000:0.0:1784936828.093757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.093859:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182592 00000100:00100000:3.0:1784936828.093870:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182592 00000100:00100000:3.0:1784936828.093987:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936828.093997:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+7:13835:x1871641503182592:12345-192.168.204.1@tcp:41:lfs.0 00000004:00000024:3.0:1784936828.094044:0:14234:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784936828.094155:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+7:13835:x1871641503182592:12345-192.168.204.1@tcp:41:lfs.0 Request processed in 159us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.094163:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:0.0:1784936828.094385:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936828.099038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.099223:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182720 00000100:00100000:1.0:1784936828.099244:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182720 00000100:00100000:1.0:1784936828.099329:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:1.0:1784936828.099340:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72410603-668c-4b8f-a839-7098c5dcbd21+5:13835:x1871641503182720:12345-192.168.204.1@tcp:13:lfs.0 00002000:00000024:1.0:1784936828.099384:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784936828.099510:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72410603-668c-4b8f-a839-7098c5dcbd21+5:13835:x1871641503182720:12345-192.168.204.1@tcp:13:lfs.0 Request processed in 171us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.099518:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00080000:0.0:1784936828.099958:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784936828.108014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.108662:0:14872:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182848 00000100:00100000:3.0:1784936828.108672:0:14872:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182848 00000100:00100000:3.0:1784936828.108794:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1784936828.108806:0:14872:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72410603-668c-4b8f-a839-7098c5dcbd21+5:13835:x1871641503182848:12345-192.168.204.1@tcp:13:lfs.0 00002000:00000024:3.0:1784936828.108858:0:14872:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936828.108969:0:14872:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72410603-668c-4b8f-a839-7098c5dcbd21+5:13835:x1871641503182848:12345-192.168.204.1@tcp:13:lfs.0 Request processed in 165us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.108981:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00080000:0.0:1784936828.109456:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784936828.282927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.283043:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503182976 00000100:00100000:1.0:1784936828.283055:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503182976 00000100:00100000:1.0:1784936828.283116:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:1.0:1784936828.283127:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+10:13869:x1871641503182976:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784936828.283146:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936828.283167:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8165200/0x6cf7a864723f6caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95123 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936828.283200:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8165200/0x6cf7a864723f6caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95123 expref: 11 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936828.283233:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8165200/0x6cf7a864723f6caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95123 expref: 11 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936828.283243:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165200, rc 0) 00000100:00100000:1.0:1784936828.283324:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13869:x1871641503182976:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 197us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.283331:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 91 00000100:00100000:2.0:1784936828.298945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.299070:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183104 00000100:00100000:3.0:1784936828.299080:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183104 00000100:00100000:3.0:1784936828.299140:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:3.0:1784936828.299150:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13869:x1871641503183104:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784936828.299592:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13869:x1871641503183104:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 442us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.299601:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 92 00000100:00100000:0.0:1784936828.300421:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524145280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936828.300505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936828.300700:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145280 00000100:00100000:3.0:1784936828.300707:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145280 00000100:00100000:3.0:1784936828.300747:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784936828.300755:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524145280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784936828.300774:0:14873:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936828.300826:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524145280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.300833:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784936828.300924:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524145280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784936828.303780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.303867:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183232 00000100:00100000:3.0:1784936828.303878:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183232 00000100:00100000:3.0:1784936828.303938:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:3.0:1784936828.303948:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13869:x1871641503183232:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784936828.304241:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13869:x1871641503183232:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 294us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.304270:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 93 00000100:00100000:0.0:1784936828.310654:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936828.310732:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183360 00000100:00100000:2.0:1784936828.310743:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183360 00000100:00100000:2.0:1784936828.310810:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:2.0:1784936828.310820:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13874:x1871641503183360:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784936828.311206:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13874:x1871641503183360:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 387us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936828.311215:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 94 00000100:00100000:2.0:1784936828.327593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936828.327818:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183488 00000100:00100000:0.0:1784936828.327830:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183488 00000100:00100000:0.0:1784936828.327897:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:0.0:1784936828.327910:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13874:x1871641503183488:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784936828.328271:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13874:x1871641503183488:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 362us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936828.328280:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 95 00000100:00100000:0.0:1784936828.335792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.335872:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183616 00000100:00100000:3.0:1784936828.335882:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183616 00000100:00100000:3.0:1784936828.335964:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:3.0:1784936828.335974:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13869:x1871641503183616:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784936828.335991:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936828.336008:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f6cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9514d expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.336035:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f6cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9514d expref: 12 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.336046:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165ac00/0x6cf7a864723f6cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9514d expref: 12 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.336056:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165ac00, rc 0) 00000100:00100000:3.0:1784936828.336163:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13869:x1871641503183616:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 189us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.336170:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 96 00000100:00100000:1.0:1784936828.342127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936828.342240:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183744 00000100:00100000:2.0:1784936828.342262:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183744 00000100:00100000:2.0:1784936828.342324:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:2.0:1784936828.342351:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13869:x1871641503183744:12345-192.168.204.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784936828.342385:0:14225:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784936828.342404:0:14225:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784936828.342409:0:14225:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784936828.342413:0:14225:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784936828.342416:0:14225:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1784936828.343939:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13869:x1871641503183744:12345-192.168.204.1@tcp:256:mount.lustre.0 Request processed in 1584us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.343950:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 97 00000100:00100000:0.0:1784936828.348725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.348817:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503183872 00000100:00100000:3.0:1784936828.348827:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503183872 00000100:00100000:3.0:1784936828.348883:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:3.0:1784936828.348894:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13869:x1871641503183872:12345-192.168.204.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784936828.348911:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936828.348930:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95154 expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.348980:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 13 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.348992:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 13 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.349001:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165aa00, rc 0) 00000100:00100000:3.0:1784936828.349067:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13869:x1871641503183872:12345-192.168.204.1@tcp:101:mount.lustre.0 Request processed in 173us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.349074:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 98 00000100:00100000:0.0:1784936828.351705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.352377:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184000 00000100:00100000:1.0:1784936828.352387:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184000 00000100:00100000:1.0:1784936828.352528:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 99 00000100:00100000:1.0:1784936828.352538:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13869:x1871641503184000:12345-192.168.204.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784936828.352836:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13869:x1871641503184000:12345-192.168.204.1@tcp:501:mount.lustre.0 Request processed in 298us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.352845:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 99 00010000:00010000:3.0:1784936828.361264:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936828.364283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936828.364399:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184128 00000100:00100000:0.0:1784936828.364411:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184128 00000100:00100000:0.0:1784936828.364524:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:0.0:1784936828.364535:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13869:x1871641503184128:12345-192.168.204.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784936828.365221:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13869:x1871641503184128:12345-192.168.204.1@tcp:503:mount.lustre.0 Request processed in 685us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936828.365229:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 100 00000100:00100000:0.0:1784936828.368409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.368915:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184256 00000100:00100000:1.0:1784936828.368926:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184256 00000100:00100000:1.0:1784936828.368981:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:1.0:1784936828.368991:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13878:x1871641503184256:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784936828.369578:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13878:x1871641503184256:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 586us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.369597:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 101 00000100:00100000:1.0:1784936828.373355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936828.378244:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184384 00000100:00100000:0.0:1784936828.378258:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184384 00000100:00100000:0.0:1784936828.378353:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:0.0:1784936828.378365:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13878:x1871641503184384:12345-192.168.204.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784936828.378678:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13878:x1871641503184384:12345-192.168.204.1@tcp:502:llog_process_th.0 Request processed in 314us (5335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936828.378686:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 102 00000100:00100000:2.0:1784936828.389523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.389788:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184512 00000100:00100000:1.0:1784936828.389801:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184512 00000100:00100000:1.0:1784936828.389858:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1784936828.389867:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2370:x1871641503184512:12345-192.168.204.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784936828.389899:0:14233:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ee7ee7fc-b827-4d2a-a16d-2454533e0d7b@192.168.204.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1784936828.389942:0:14233:0:(genops.c:1406:class_connect()) connect: client ee7ee7fc-b827-4d2a-a16d-2454533e0d7b, cookie 0x6cf7a864723f6cc4 00000004:00100000:1.0:1784936828.389976:0:14233:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784936828.390126:0:14233:0:(import.c:65:import_set_state_nolock()) ffff9096c722d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784936828.390216:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:2370:x1871641503184512:12345-192.168.204.1@tcp:38:mount.lustre.0 Request processed in 348us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.390223:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1784936828.391673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.391720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.391756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936828.391852:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185152 00000100:00100000:0.0:1784936828.391860:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185152 00000100:00100000:2.0:1784936828.391861:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184896 00000100:00100000:2.0:1784936828.391868:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184896 00000100:00100000:0.0:1784936828.391908:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185024 00000100:00100000:0.0:1784936828.391913:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185024 00000100:00100000:2.0:1784936828.391923:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1784936828.391938:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:2.0:1784936828.391940:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+7:2371:x1871641503184896:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936828.391950:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72410603-668c-4b8f-a839-7098c5dcbd21+5:2371:x1871641503185152:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:3.0:1784936828.392086:0:14869:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784936828.392098:0:14869:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784936828.392378:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+7:2371:x1871641503184896:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 443us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936828.392387:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1784936828.392406:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72410603-668c-4b8f-a839-7098c5dcbd21+5:2371:x1871641503185152:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 457us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936828.392414:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:0.0:1784936828.392454:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1784936828.392462:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72410603-668c-4b8f-a839-7098c5dcbd21+5:2371:x1871641503185024:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936828.392635:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72410603-668c-4b8f-a839-7098c5dcbd21+5:2371:x1871641503185024:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 173us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936828.392642:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:0.0:1784936828.402941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.403397:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184640 00000100:00100000:3.0:1784936828.403408:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184640 00000100:00100000:3.0:1784936828.403524:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1784936828.403535:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:0:x1871641503184640:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784936828.403580:0:14234:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784936828.403655:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:0:x1871641503184640:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 121us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.403662:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00080000:0.0:1784936828.403726:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784936828.405674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936828.405766:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503184768 00000100:00100000:1.0:1784936828.405776:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503184768 00000100:00100000:1.0:1784936828.405831:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936828.405841:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13869:x1871641503184768:12345-192.168.204.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784936828.405871:0:14233:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784936828.405941:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13869:x1871641503184768:12345-192.168.204.1@tcp:41:mount.lustre.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936828.405948:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:1.0:1784936828.410935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936828.411041:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185280 00000100:00100000:2.0:1784936828.411052:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185280 00000100:00100000:2.0:1784936828.411109:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:2.0:1784936828.411119:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13869:x1871641503185280:12345-192.168.204.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784936828.411398:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13869:x1871641503185280:12345-192.168.204.1@tcp:40:mount.lustre.0 Request processed in 279us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936828.411406:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1784936828.414007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936828.414048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.414135:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185408 00000100:00100000:3.0:1784936828.414145:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185408 00000100:00100000:3.0:1784936828.414190:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185536 00000100:00100000:3.0:1784936828.414194:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185536 00000100:00100000:3.0:1784936828.414222:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:3.0:1784936828.414230:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1871641503185408:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784936828.414277:0:14869:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ee7ee7fc-b827-4d2a-a16d-2454533e0d7b@192.168.204.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1784936828.414313:0:14869:0:(genops.c:1406:class_connect()) connect: client ee7ee7fc-b827-4d2a-a16d-2454533e0d7b, cookie 0x6cf7a864723f6ccb 00002000:00100000:3.0:1784936828.414324:0:14869:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee7ee7fc-b827-4d2a-a16d-2454533e0d7b/ffff9095c3230800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784936828.414337:0:14869:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784936828.414659:0:14869:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784936828.414688:0:14869:0:(import.c:65:import_set_state_nolock()) ffff9095c3236000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936828.414752:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:2370:x1871641503185408:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 521us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.414760:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:3.0:1784936828.414779:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:3.0:1784936828.414784:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1871641503185536:12345-192.168.204.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784936828.414801:0:14869:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ee7ee7fc-b827-4d2a-a16d-2454533e0d7b@192.168.204.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1784936828.414830:0:14869:0:(genops.c:1406:class_connect()) connect: client ee7ee7fc-b827-4d2a-a16d-2454533e0d7b, cookie 0x6cf7a864723f6cd2 00002000:00100000:3.0:1784936828.414836:0:14869:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee7ee7fc-b827-4d2a-a16d-2454533e0d7b/ffff9095c3236800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cf ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784936828.414843:0:14869:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784936828.414991:0:14869:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784936828.415007:0:14869:0:(import.c:65:import_set_state_nolock()) ffff9095c3234000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784936828.415031:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ede54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:2370:x1871641503185536:12345-192.168.204.1@tcp:8:mount.lustre.0 Request processed in 246us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.415038:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1784936828.416470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.417278:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185664 00000100:00100000:3.0:1784936828.417289:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185664 00000100:00100000:3.0:1784936828.417385:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1784936828.417396:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13869:x1871641503185664:12345-192.168.204.1@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784936828.417758:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784936828.417921:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13869:x1871641503185664:12345-192.168.204.1@tcp:33:mount.lustre.0 Request processed in 526us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.417930:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:1.0:1784936828.599247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936828.599354:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185792 00000100:00100000:3.0:1784936828.599367:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185792 00000100:00100000:3.0:1784936828.599481:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1784936828.599492:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:13899:x1871641503185792:12345-192.168.204.1@tcp:101:mkdir.0 00010000:00010000:3.0:1784936828.599525:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936828.599548:0:14234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9517e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.599615:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.599631:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.599646:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936828.599886:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784936828.599891:0:14234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936828.599986:0:14234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.600018:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 8 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.600051:0:14234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 7 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936828.600060:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:3.0:1784936828.600063:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936828.600067:0:14234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b200, rc 0) 00000100:00100000:3.0:1784936828.600134:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+7:13899:x1871641503185792:12345-192.168.204.1@tcp:101:mkdir.0 Request processed in 644us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936828.600141:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00010000:00010000:1.0:1784936829.385704:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936830.410543:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784936830.741189:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1784936830.925459:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee7ee7fc-b827-4d2a-a16d-2454533e0d7b 00000001:00100000:2.0:1784936830.925496:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72410603-668c-4b8f-a839-7098c5dcbd21 00000001:02000400:3.0:1784936831.267032:0:16100:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784936831.433538:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936832.457022:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784936832.905625:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524145408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784936832.905705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936832.905777:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145408 00000100:00100000:3.0:1784936832.905785:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145408 00000100:00080000:0.0:1784936832.905919:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784936832.906097:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936832.906107:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524145408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784936832.906145:0:14873:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784936832.906193:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524145408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936832.906200:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784936832.906236:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1784936832.906258:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524145408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784936832.908839:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524145664:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.908905:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936832.908941:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784936832.908947:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524145536:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.908973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936832.909071:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524146048:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.909099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936832.909128:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145664 00000100:00100000:0.0:1784936832.909135:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145664 00000100:00100000:0.0:1784936832.909191:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936832.909199:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524145664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.909249:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524145664:12345-0@lo:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936832.909255:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784936832.909504:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524146048 00000100:00100000:2.0:1784936832.909509:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524146048 00000100:00100000:2.0:1784936832.909541:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784936832.909547:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524146048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.909940:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145536 00000100:00100000:0.0:1784936832.909946:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145536 00000100:00100000:0.0:1784936832.910052:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784936832.910062:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3308:x1871641524145536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.910103:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3308:x1871641524145536:12345-0@lo:400:kworker.0 Request processed in 43us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936832.910110:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784936832.910197:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1871641524146048:12345-0@lo:400:kworker.0 Request processed in 39us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936832.910205:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784936832.910371:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524145792:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.910403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936832.910453:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784936832.910462:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524145920:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.910484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936832.910519:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145792 00000100:00100000:0.0:1784936832.910529:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145792 00000100:00100000:0.0:1784936832.910553:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524145920 00000100:00100000:0.0:1784936832.910556:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524145920 00000100:00100000:0.0:1784936832.910573:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784936832.910579:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524145792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.911255:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1871641524145792:12345-0@lo:400:kworker.0 Request processed in 673us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936832.911263:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784936832.912092:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784936832.912109:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1871641524145792:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.912110:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524145920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.912161:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1871641524145920:12345-0@lo:400:kworker.0 Request processed in 60us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936832.912166:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1871641524145920:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.912168:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1784936832.913728:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784936832.913737:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784936832.913798:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524145536:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.913817:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1871641524146048:0@lo:400:kworker.0 00000100:00100000:0.0:1784936832.913829:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524145664:0@lo:400:kworker.0 00000001:00100000:0.0:1784936832.982276:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee7ee7fc-b827-4d2a-a16d-2454533e0d7b 00000001:00100000:3.0:1784936833.008782:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee7ee7fc-b827-4d2a-a16d-2454533e0d7b 00000100:00100000:2.0:1784936833.416705:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784936833.416734:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524146176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936833.416824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936833.416918:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524146176 00000100:00100000:2.0:1784936833.416926:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524146176 00000100:00100000:2.0:1784936833.416985:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784936833.416996:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524146176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784936833.417037:0:14873:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936833.417101:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524146176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.417108:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784936833.417277:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524146176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784936833.461980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936833.462026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936833.462062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936833.462087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936833.462104:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503185920 00000100:00100000:2.0:1784936833.462111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936833.462116:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503185920 00000100:00100000:2.0:1784936833.462136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936833.462170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936833.462181:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:3.0:1784936833.462193:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:2374:x1871641503185920:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936833.462198:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186432 00000100:00100000:2.0:1784936833.462203:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186432 00000100:00100000:2.0:1784936833.462251:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186048 00000100:00100000:3.0:1784936833.462270:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:2374:x1871641503185920:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.462271:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186048 00000100:00100000:3.0:1784936833.462280:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 104 00000100:00100000:2.0:1784936833.462301:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:2.0:1784936833.462311:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:2374:x1871641503186432:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936833.462350:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:2374:x1871641503186432:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 41us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.462356:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:2.0:1784936833.462372:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:2.0:1784936833.462379:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+6:2374:x1871641503186048:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936833.462407:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+6:2374:x1871641503186048:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.462415:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:1.0:1784936833.462463:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186176 00000100:00100000:1.0:1784936833.462469:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186176 00000100:00100000:2.0:1784936833.462473:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186688 00000100:00100000:2.0:1784936833.462479:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186688 00000100:00100000:1.0:1784936833.462498:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186304 00000100:00100000:1.0:1784936833.462502:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186304 00000100:00100000:2.0:1784936833.462508:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186560 00000100:00100000:2.0:1784936833.462512:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186560 00000100:00100000:1.0:1784936833.462527:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936833.462537:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2374:x1871641503186176:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936833.462544:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1784936833.462554:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2374:x1871641503186688:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936833.462572:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2374:x1871641503186176:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 36us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936833.462578:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936833.462593:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:1.0:1784936833.462600:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2374:x1871641503186304:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936833.462606:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2374:x1871641503186688:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 51us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.462614:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:1.0:1784936833.462631:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2374:x1871641503186304:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.462636:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1784936833.462645:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:2.0:1784936833.462651:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2374:x1871641503186560:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:2.0:1784936833.462682:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2374:x1871641503186560:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 36us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936833.462688:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00080000:2.0:1784936833.462724:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784936833.462728:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784936833.462730:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784936833.489768:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784936834.141622:0:16250:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc69e339e0 20000000:00000080:3.0:1784936834.141643:0:16250:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9095c217a400 uarg=0000000000000000 20000000:01000000:3.0:1784936834.141683:0:16250:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784936834.141690:0:16250:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784936834.141695:0:16250:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784936834.144209:0:16251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1784936834.144304:0:16250:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784936834.153392:0:16250:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784936834.154503:0:16250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154524:0:16250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 18 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154533:0:16250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 18 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154540:0:16250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 18 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154550:0:16250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154557:0:16250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 12 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154564:0:16250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154612:0:16250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 12 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154630:0:16250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 12 pid: 14227 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.154662:0:16250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146304:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936834.154775:0:16250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154796:0:16250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 12 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.154805:0:16250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146432:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936834.154838:0:16250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 18 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154847:0:16250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 18 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.154856:0:16250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146560:0@lo:104: 00000100:00100000:2.0:1784936834.154894:0:16250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784936834.154938:0:16250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 18 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.154946:0:16250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 18 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.154954:0:16250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec822d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146688:0@lo:104: 00000100:00100000:2.0:1784936834.154974:0:16250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784936834.154993:0:16250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 18 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.155000:0:16250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 18 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.155017:0:16250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec822680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146816:0@lo:104: 00000100:00100000:2.0:1784936834.155049:0:16250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936834.155049:0:14217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524146560 00000100:00100000:0.0:1784936834.155059:0:14217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524146560 00000100:00100000:2.0:1784936834.155061:0:16250:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04480 going to sleep for 11 seconds 00000100:00100000:0.0:1784936834.155109:0:14217:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784936834.155119:0:14217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524146688 00000100:00100000:0.0:1784936834.155122:0:14217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524146688 00000100:00100000:0.0:1784936834.155143:0:14217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524146816 00000100:00100000:0.0:1784936834.155145:0:14217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524146816 00000100:00100000:0.0:1784936834.155158:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784936834.155165:0:14217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+5:16250:x1871641524146560:12345-0@lo:104: 00010000:00010000:0.0:1784936834.155178:0:14217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.155236:0:14217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784936834.155241:0:14217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+5:16250:x1871641524146560:12345-0@lo:104: Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936834.155249:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784936834.155264:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936834.155270:0:14217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+4:16250:x1871641524146688:12345-0@lo:104: 00010000:00010000:0.0:1784936834.155278:0:14217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.155298:0:16250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146560:0@lo:104: 00000100:00100000:2.0:1784936834.155311:0:16250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec822d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146688:0@lo:104: 00010000:00010000:0.0:1784936834.155314:0:14217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784936834.155321:0:14217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+4:16250:x1871641524146688:12345-0@lo:104: Request processed in 51us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936834.155327:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784936834.155339:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936834.155344:0:14217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ee013c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:16250:x1871641524146816:12345-0@lo:104: 00010000:00010000:0.0:1784936834.155352:0:14217:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.155415:0:14217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784936834.155420:0:14217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ee013c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+3:16250:x1871641524146816:12345-0@lo:104: Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936834.155457:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784936834.155717:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784936834.155724:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155734:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165c00 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936834.155738:0:14222:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155758:0:14222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936834.155766:0:14222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936834.155771:0:14222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784936834.155811:0:14222:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155818:0:14222:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936834.155840:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155848:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096c8165c00/0x6cf7a864723f6b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6b5f expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155860:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784936834.155863:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155869:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19000 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936834.155871:0:14222:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155878:0:14222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936834.155884:0:14222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936834.155895:0:14222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784936834.155908:0:14222:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155913:0:14222:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936834.155918:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155924:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096f4d19000/0x6cf7a864723f6a24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f6a2b expref: -99 pid: 14867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155932:0:14222:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784936834.155936:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155941:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f4d19200 already unused, calling callback (ffffffffc1a61c20) 10000000:00010000:1.0:1784936834.155944:0:14222:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155950:0:14222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784936834.155956:0:14222:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784936834.155960:0:14222:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784936834.155983:0:14222:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.155988:0:14222:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784936834.156008:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.156014:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.101@tcp lock: ffff9096f4d19200/0x6cf7a864723f69d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6cf7a864723f69de expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.156029:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936834.156031:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936834.156034:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784936834.156042:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936834.156058:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524147072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936834.156103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936834.156158:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784936834.156163:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524146944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936834.156185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936834.156212:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524147200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784936834.156219:0:14220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147072 00000100:00100000:0.0:1784936834.156226:0:14220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147072 00000100:00100000:1.0:1784936834.156238:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784936834.156254:0:14220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 19 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.156262:0:16250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec822680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146816:0@lo:104: 00000100:00100000:0.0:1784936834.156279:0:14220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524146944 00000100:00100000:0.0:1784936834.156283:0:14220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524146944 00000100:00100000:1.0:1784936834.156294:0:14219:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147200 00010000:00010000:0.0:1784936834.156299:0:14220:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 20 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936834.156301:0:14219:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147200 00000100:00100000:0.0:1784936834.156316:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784936834.156323:0:14219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 21 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936834.156325:0:14220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+21:3306:x1871641524147072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784936834.156341:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936834.156348:0:14220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 21 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936834.156349:0:14219:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784936834.156359:0:14219:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1784936834.156363:0:14220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 21 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936834.156382:0:14218:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784936834.156391:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784936834.156398:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+21:3306:x1871641524146944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784936834.156417:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936834.156422:0:14218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 21 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.156664:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea5e00/0x6cf7a864723f6a2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f6a24 expref: 21 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.156678:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936834.156876:0:14220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+20:3306:x1871641524147072:12345-0@lo:103:ldlm_bl.0 Request processed in 552us (771us total) trans 0 rc 0/0 00010000:00010000:1.0:1784936834.156882:0:14218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 20 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936834.156887:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784936834.156901:0:14218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096d9ea4400/0x6cf7a864723f6b5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f6b58 expref: 19 pid: 14226 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936834.156905:0:14220:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1784936834.156913:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936834.156915:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784936834.156931:0:14220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d46a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:3307:x1871641524147200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784936834.156940:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784936834.156946:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:3306:x1871641524146944:12345-0@lo:103:ldlm_bl.0 Request processed in 548us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936834.156953:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784936834.156981:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524146944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784936834.156988:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3306:1871641524147072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784936834.157020:0:14220:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 17 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.157029:0:14220:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 17 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.157039:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096ee26b800/0x6cf7a864723f69de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6cf7a864723f69d7 expref: 17 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936834.157047:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784936834.157082:0:14220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d46a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:3307:x1871641524147200:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936834.157088:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784936834.157160:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3307:1871641524147200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784936834.157476:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936834.163220:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936834.163271:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186816 00000100:00100000:1.0:1784936834.163283:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186816 00000100:00100000:2.0:1784936834.163312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:1.0:1784936834.163328:0:14218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 13 pid: 14227 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936834.163368:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503186944 00000100:00100000:1.0:1784936834.163371:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503186944 00010000:00010000:1.0:1784936834.163385:0:14218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 14 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936834.163419:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:1.0:1784936834.163443:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+14:2372:x1871641503186816:12345-192.168.204.1@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784936834.163462:0:16250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146304:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936834.163476:0:16250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16250:1871641524146432:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936834.163509:0:16250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.163527:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936834.163548:0:14218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 14 pid: 14227 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.163562:0:14218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 14 pid: 14227 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.163582:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:1.0:1784936834.163582:0:14218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c165aa00/0x6cf7a864723f6cbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95154 expref: 14 pid: 14227 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936834.163591:0:14219:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:2372:x1871641503186944:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936834.163598:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936834.163599:0:14219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936834.163603:0:14219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 13 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163612:0:14219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 13 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163621:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096c8164800/0x6cf7a864723f6c85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c950f2 expref: 13 pid: 14225 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163632:0:14219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163640:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936834.163645:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:2372:x1871641503186816:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 217us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936834.163652:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00010000:00010000:2.0:1784936834.163664:0:14219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163671:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163678:0:14219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163686:0:14219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163693:0:14219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4ee00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936834.163697:0:14219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163705:0:14219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163727:0:14219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936834.163735:0:14219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936834.163755:0:14219:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:2372:x1871641503186944:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 166us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936834.163763:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00010000:00010000:1.0:1784936834.163777:0:16250:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.163784:0:16250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.163790:0:16250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6ce7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936834.504662:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784936835.276524:0:14230:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784936835.276532:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096e8586000 from 10 10000000:01000000:2.0:1784936835.276537:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784936835.276584:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.276607:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.276619:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936835.276647:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec820000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784936835.276716:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936835.276770:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936835.277519:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147328 00000100:00100000:3.0:1784936835.277528:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147328 00000100:00100000:3.0:1784936835.281853:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784936835.281876:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+16:14230:x1871641524147328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784936835.281901:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936835.281926:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c165a800/0x6cf7a864723f6cf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6cee expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936835.281973:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c165a800/0x6cf7a864723f6cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6cee expref: 17 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936835.281985:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c165a800/0x6cf7a864723f6cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6cee expref: 17 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936835.281994:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165a800, rc 0) 00000100:00100000:3.0:1784936835.282097:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:14230:x1871641524147328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.282104:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784936835.284186:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec820000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936835.284211:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6cf5 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.284222:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6cf5 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936835.284298:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.284346:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.289543:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cab180 going to sleep for 11 seconds 00000100:00100000:1.0:1784936835.289633:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147456 00000100:00100000:1.0:1784936835.289643:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147456 00000100:00100000:1.0:1784936835.289703:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784936835.289712:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:14230:x1871641524147456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936835.290075:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:14230:x1871641524147456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936835.290084:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784936835.292918:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.292985:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.293066:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.293105:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cab180 going to sleep for 11 seconds 00000100:00100000:1.0:1784936835.293228:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147584 00000100:00100000:1.0:1784936835.293236:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147584 00000100:00100000:1.0:1784936835.293281:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784936835.293290:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ef0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:14230:x1871641524147584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784936835.293563:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ef0fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:14230:x1871641524147584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936835.293571:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784936835.294061:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784936835.294978:0:16303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784936835.295312:0:14230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784936835.295335:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936835.295345:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6cf5 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.295357:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096f7f4f600/0x6cf7a864723f6cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6cf5 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936835.295368:0:14230:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936835.295371:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096c9b8b000 from 10 10000000:01000000:0.0:1784936835.295374:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936835.295425:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.295456:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.295467:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936835.295490:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.295542:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.295576:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cab180 going to sleep for 11 seconds 00000100:00100000:1.0:1784936835.296543:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147712 00000100:00100000:1.0:1784936835.296553:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147712 00000100:00100000:1.0:1784936835.296609:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784936835.296619:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+17:14230:x1871641524147712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784936835.296634:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936835.296647:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096c8165c00/0x6cf7a864723f6d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6cfc expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936835.296672:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096c8165c00/0x6cf7a864723f6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6cfc expref: 18 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936835.296682:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096c8165c00/0x6cf7a864723f6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6cfc expref: 18 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936835.296692:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165c00, rc 0) 00000100:00100000:1.0:1784936835.296767:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524147712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936835.296773:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784936835.297547:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936835.297567:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6d03 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.297593:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6d03 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936835.297666:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.297702:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.297742:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cab180 going to sleep for 11 seconds 00000100:00100000:3.0:1784936835.297787:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147840 00000100:00100000:3.0:1784936835.297793:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147840 00000100:00100000:3.0:1784936835.297828:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784936835.297835:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524147840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.298083:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524147840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.298091:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784936835.298264:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.298292:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.298332:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.298356:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cab180 going to sleep for 11 seconds 00000100:00100000:3.0:1784936835.298404:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524147968 00000100:00100000:3.0:1784936835.298409:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524147968 00000100:00100000:3.0:1784936835.298482:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784936835.298489:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524147968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.298641:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524147968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.298648:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784936835.298754:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524147968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784936835.302326:0:16304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784936835.302669:0:14230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784936835.302696:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784936835.302707:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6d03 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.302719:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26a000/0x6cf7a864723f6cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6d03 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784936835.302730:0:14230:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784936835.302733:0:14230:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9096ff4ed800 from 10 10000000:01000000:0.0:1784936835.302736:0:14230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784936835.302774:0:14230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.302783:0:14230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.302807:0:14230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936835.302833:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524148096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.302898:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.302942:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784936835.302990:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524148096 00000100:00100000:2.0:1784936835.302997:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524148096 00000100:00100000:2.0:1784936835.303079:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784936835.303089:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+18:14230:x1871641524148096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936835.303102:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936835.303116:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f7f4fe00/0x6cf7a864723f6d11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6cf7a864723f6d0a expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.303140:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f7f4fe00/0x6cf7a864723f6d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6cf7a864723f6d0a expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.303151:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f7f4fe00/0x6cf7a864723f6d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6cf7a864723f6d0a expref: 19 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.303160:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4fe00, rc 0) 00000100:00100000:2.0:1784936835.303211:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524148096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936835.303218:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784936835.306514:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524148096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784936835.306544:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6d11 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936835.306556:0:14230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6cf7a864723f6d11 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936835.306636:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.306697:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784936835.306952:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936835.310468:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524148224 00000100:00100000:3.0:1784936835.310484:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524148224 00000100:00100000:3.0:1784936835.310564:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784936835.310572:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524148224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.310951:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524148224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (4251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.310961:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784936835.314576:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.314657:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524148352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.314750:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936835.314790:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524148352 00000100:00100000:3.0:1784936835.314797:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524148352 00000100:00100000:3.0:1784936835.314835:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784936835.314843:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524148352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.315029:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:14230:x1871641524148352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.315037:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784936835.315091:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0444b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784936835.315105:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff427b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8567782c-cd42-40bd-85ed-bd4db0d07a3f:14230:1871641524148352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784936835.315800:0:16306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784936835.315852:0:14230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784936835.315872:0:14230:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784936835.315883:0:14230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6d11 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936835.315894:0:14230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.101@tcp lock: ffff9096ee26b800/0x6cf7a864723f6d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6cf7a864723f6d11 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936835.381521:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936835.381731:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187072 00000100:00100000:2.0:1784936835.381743:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187072 00000100:00100000:2.0:1784936835.381799:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:2.0:1784936835.381810:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+11:13751:x1871641503187072:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936835.381827:0:14226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936835.381846:0:14226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6d18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95185 expref: -99 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.381874:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95185 expref: 12 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.381886:0:14226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f7f4ee00/0x6cf7a864723f6d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95185 expref: 12 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.381897:0:14226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4ee00, rc 0) 00000100:00100000:2.0:1784936835.381963:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13751:x1871641503187072:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 154us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936835.381970:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 114 00000100:00100000:0.0:1784936835.386950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936835.386987:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187200 00000100:00100000:0.0:1784936835.386998:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187200 00000100:00100000:0.0:1784936835.387162:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:0.0:1784936835.387174:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13751:x1871641503187200:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784936835.387515:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13751:x1871641503187200:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 341us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936835.387524:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 115 00000100:00100000:0.0:1784936835.397199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936835.400897:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187328 00000100:00100000:3.0:1784936835.400913:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187328 00000100:00100000:3.0:1784936835.400977:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:3.0:1784936835.400988:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13751:x1871641503187328:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.401424:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13751:x1871641503187328:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 435us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.401459:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 116 00000100:00100000:2.0:1784936835.407532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936835.407585:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187456 00000100:00100000:2.0:1784936835.407595:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187456 00000100:00100000:2.0:1784936835.407647:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:2.0:1784936835.407659:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+12:13751:x1871641503187456:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784936835.407682:0:14227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936835.407708:0:14227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9096f7f4fa00/0x6cf7a864723f6d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9518c expref: -99 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.407745:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9096f7f4fa00/0x6cf7a864723f6d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9518c expref: 13 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.407767:0:14227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9096f7f4fa00/0x6cf7a864723f6d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9518c expref: 13 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936835.407777:0:14227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4fa00, rc 0) 00000100:00100000:2.0:1784936835.407849:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13751:x1871641503187456:12345-192.168.204.1@tcp:101:ll_cfg_requeue.0 Request processed in 192us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936835.407858:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 117 00000100:00100000:3.0:1784936835.415167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936835.415845:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187584 00000100:00100000:1.0:1784936835.415855:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187584 00000100:00100000:1.0:1784936835.415906:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:1.0:1784936835.415916:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13751:x1871641503187584:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784936835.422079:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13751:x1871641503187584:12345-192.168.204.1@tcp:501:ll_cfg_requeue.0 Request processed in 6154us (6910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936835.422092:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 118 00000100:00100000:3.0:1784936835.432343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936835.432403:0:14226:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187712 00000100:00100000:3.0:1784936835.432412:0:14226:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187712 00000100:00100000:3.0:1784936835.432483:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 119 00000100:00100000:3.0:1784936835.432493:0:14226:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13751:x1871641503187712:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784936835.432724:0:14226:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:13751:x1871641503187712:12345-192.168.204.1@tcp:503:ll_cfg_requeue.0 Request processed in 232us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936835.432732:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 119 00010000:00010000:1.0:1784936835.530556:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936836.552711:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784936837.229902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.230077:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503187840 00000100:00100000:2.0:1784936837.230087:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503187840 00000100:00100000:2.0:1784936837.230181:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1784936837.230195:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+6:14408:x1871641503187840:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936837.230220:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.230247:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6d26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95193 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230316:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230330:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230343:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230370:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230397:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230405:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230947:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f400/0x6cf7a864723f6d3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230958:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f400/0x6cf7a864723f6d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.230965:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f400/0x6cf7a864723f6d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.231040:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784936837.231043:0:14233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936837.231129:0:14233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f400/0x6cf7a864723f6d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784936837.231814:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784936837.232682:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232695:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232703:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232709:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.232713:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232733:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232749:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:2.0:1784936837.232752:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.232758:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232764:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.232781:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233687:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233695:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233700:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.233704:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233711:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233721:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9096c6420200) 00010000:00010000:2.0:1784936837.233724:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.233727:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233747:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233809:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95193 expref: 8 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233823:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f400/0x6cf7a864723f6d3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95193 expref: 7 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.233830:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9096c6420700) 00010000:00010000:2.0:1784936837.233832:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784936837.233834:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4f400, rc 0) 00000100:00100000:2.0:1784936837.233908:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+7:14408:x1871641503187840:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 3717us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.233916:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:3.0:1784936837.237492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.237594:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188096 00000100:00100000:2.0:1784936837.237609:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188096 00000100:00100000:2.0:1784936837.237681:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:2.0:1784936837.237692:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+7:14408:x1871641503188096:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784936837.237712:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.237732:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9519a expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.237812:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.237825:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.237849:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.237865:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.237872:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.237879:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238404:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f200/0x6cf7a864723f6d57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238414:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f200/0x6cf7a864723f6d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238420:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f200/0x6cf7a864723f6d57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.238461:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784936837.238940:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238949:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238956:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238963:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.238973:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238982:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.238995:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9096c6420700) 00010000:00010000:2.0:1784936837.238999:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.239004:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239011:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239025:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239031:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239036:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239041:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.239044:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239050:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239056:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9096c6420400) 00010000:00010000:2.0:1784936837.239059:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.239068:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239074:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239617:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9519a expref: 10 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239633:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4f200/0x6cf7a864723f6d57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9519a expref: 9 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.239640:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c6420b00) 00010000:00010000:2.0:1784936837.239642:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.239644:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4f200, rc 0) 00000100:00100000:2.0:1784936837.239716:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+9:14408:x1871641503188096:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 2025us (2239us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784936837.239723:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:3.0:1784936837.250543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.251118:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188224 00000100:00100000:2.0:1784936837.251132:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188224 00000100:00100000:2.0:1784936837.251258:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:2.0:1784936837.251270:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+9:14408:x1871641503188224:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784936837.251475:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+9:14408:x1871641503188224:12345-192.168.204.1@tcp:59:lhsmtool_posix.0 Request processed in 206us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.251483:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:1.0:1784936837.264556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.266171:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188352 00000100:00100000:2.0:1784936837.266191:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188352 00000100:00100000:2.0:1784936837.266289:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:2.0:1784936837.266302:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+9:14414:x1871641503188352:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936837.266358:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.266389:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951a1 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266515:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266533:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266548:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266566:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266574:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266582:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266928:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266937:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266944:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266951:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.266962:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266971:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.266986:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:2.0:1784936837.266990:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.266996:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267003:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267017:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267024:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267030:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267035:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.267039:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267044:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267051:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9096c6420400) 00010000:00010000:2.0:1784936837.267053:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.267063:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267069:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6d73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267108:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951a1 expref: 10 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267120:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:2.0:1784936837.267122:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.267126:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951a1 expref: 10 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.267136:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4ea00, rc 0) 00000100:00100000:2.0:1784936837.267225:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+9:14414:x1871641503188352:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 926us (2744us total) trans 0 rc 301/301 00000100:00100000:2.0:1784936837.267234:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 18 00000100:00100000:0.0:1784936837.276138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936837.276259:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188480 00000100:00100000:1.0:1784936837.276273:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188480 00000100:00100000:1.0:1784936837.276354:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:1.0:1784936837.276366:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:72410603-668c-4b8f-a839-7098c5dcbd21+9:14414:x1871641503188480:12345-192.168.204.1@tcp:700:lfs.0 00000100:00100000:1.0:1784936837.276597:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:72410603-668c-4b8f-a839-7098c5dcbd21+9:14414:x1871641503188480:12345-192.168.204.1@tcp:700:lfs.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936837.276605:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1784936837.281306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.281955:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188736 00000100:00100000:2.0:1784936837.281966:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188736 00000100:00100000:2.0:1784936837.282069:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 19 00000100:00100000:2.0:1784936837.282080:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+9:14414:x1871641503188736:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:2.0:1784936837.282139:0:14233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936837.282168:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ca8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9511c expref: 9 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.282188:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:2.0:1784936837.282194:0:14233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936837.282538:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.282553:0:14233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 5 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.282563:0:14233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.282596:0:14233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 5 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.282613:0:14233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 5 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.282628:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec821180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1871641524148480:192.168.204.1@tcp:104: 00000100:00100000:2.0:1784936837.282991:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096d0d04f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936837.285801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.285898:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec821180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1871641524148480:192.168.204.1@tcp:104: 00010000:00010000:2.0:1784936837.285928:0:14233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936837.285945:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188864 00000100:00100000:1.0:1784936837.285954:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188864 00010000:00010000:1.0:1784936837.286015:0:14218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 6 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936837.286055:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:1.0:1784936837.286063:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:2371:x1871641503188864:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784936837.286079:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784936837.286086:0:14218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 6 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936837.286111:0:14218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 6 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936837.286132:0:14218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6ce0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9517e expref: 6 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936837.286150:0:14218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:1.0:1784936837.286155:0:14218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936837.286166:0:14218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936837.286173:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936837.286202:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784936837.286249:0:14233:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936837.286251:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2371:x1871641503188864:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 187us (458us total) trans 0 rc 0/0 00010000:00010000:3.0:1784936837.286266:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936837.286267:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00010000:00010000:3.0:1784936837.286293:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.286310:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.286319:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784936837.286651:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1784936837.292290:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784936837.292310:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.292322:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.292330:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.292336:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4ea00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936837.292341:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.292363:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.292380:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9096c7246b00) 00010000:00010000:3.0:1784936837.292383:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936837.292388:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.292394:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4ea00/0x6cf7a864723f6d7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784936837.292458:0:14233:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000836084 reply state 000000003e42c754 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.292470:0:14233:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784936837.292573:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+10:14414:x1871641503188736:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 10490us (11272us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784936837.292585:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 19 00010000:00010000:2.0:1784936837.294055:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.294072:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.294079:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.294098:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165b000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.294104:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.294113:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.294126:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90970053a700) 00010000:00010000:2.0:1784936837.294129:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.294133:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.294140:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d81 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936837.344902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.345132:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503188992 00000100:00100000:3.0:1784936837.345144:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503188992 00000100:00100000:3.0:1784936837.345207:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1784936837.345218:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+9:14422:x1871641503188992:12345-192.168.204.1@tcp:101:lctl.0 00010000:00010000:3.0:1784936837.345244:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936837.345269:0:14234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951a8 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.345338:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6d8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.345366:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.345379:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936837.345567:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784936837.345571:0:14234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936837.345616:0:14234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.345662:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951a8 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.345682:0:14234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b200/0x6cf7a864723f6d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951a8 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.345691:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:3.0:1784936837.345695:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936837.345698:0:14234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b200, rc 0) 00000100:00100000:3.0:1784936837.345758:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+10:14422:x1871641503188992:12345-192.168.204.1@tcp:101:lctl.0 Request processed in 542us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936837.345765:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 20 00000100:00100000:3.0:1784936837.363269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.363384:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503189120 00000100:00100000:2.0:1784936837.363394:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503189120 00000100:00100000:3.0:1784936837.363581:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:3.0:1784936837.363593:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:14423:x1871641503189120:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936837.363614:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936837.363635:0:14234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951af expref: -99 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.363700:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165aa00/0x6cf7a864723f6d9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.363714:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165aa00/0x6cf7a864723f6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.363724:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165aa00/0x6cf7a864723f6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936837.363798:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784936837.363801:0:14234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936837.363824:0:14234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165aa00/0x6cf7a864723f6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.363845:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951af expref: 7 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.363862:0:14234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165aa00/0x6cf7a864723f6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951af expref: 6 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.363872:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:3.0:1784936837.363875:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936837.363879:0:14234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165aa00, rc 0) 00000100:00100000:3.0:1784936837.363945:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:14423:x1871641503189120:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 355us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936837.363952:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 21 00000100:00100000:1.0:1784936837.366951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936837.367120:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503189248 00000100:00100000:0.0:1784936837.367130:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503189248 00000100:00100000:0.0:1784936837.367185:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:0.0:1784936837.367195:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+6:14423:x1871641503189248:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:0.0:1784936837.367215:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936837.367239:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6da4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951b6 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367302:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367317:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367330:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367357:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367365:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367371:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367507:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6db9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367527:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367536:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936837.367577:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784936837.367581:0:14232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936837.367606:0:14232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367618:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367625:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367632:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367638:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936837.367642:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367649:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367662:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:0.0:1784936837.367665:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936837.367670:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367687:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367702:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367708:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367713:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367717:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ba00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936837.367720:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367731:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367739:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9096caf90a00) 00010000:00010000:0.0:1784936837.367742:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936837.367745:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367751:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6db2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367786:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6da4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951b6 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367812:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6db9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951b6 expref: 7 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.367820:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9096caf90500) 00010000:00010000:0.0:1784936837.367823:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784936837.367825:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ac00, rc 0) 00000100:00100000:0.0:1784936837.367897:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+7:14423:x1871641503189248:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 703us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936837.367905:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 22 00000100:00100000:1.0:1784936837.373166:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.373260:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503189504 00000100:00100000:2.0:1784936837.373270:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503189504 00000100:00100000:2.0:1784936837.373329:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:2.0:1784936837.373338:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+7:14423:x1871641503189504:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936837.373369:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.373389:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951bd expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.373681:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784936837.373948:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951bd expref: 9 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.373988:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:2.0:1784936837.373991:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936837.373998:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951bd expref: 9 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.374012:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e200, rc 0) 00000100:00100000:2.0:1784936837.374068:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+8:14423:x1871641503189504:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 730us (911us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1784936837.374075:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 23 00000100:00100000:3.0:1784936837.378797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936837.378891:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503189760 00000100:00100000:0.0:1784936837.378902:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503189760 00000100:00100000:0.0:1784936837.378957:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 24 00000100:00100000:0.0:1784936837.378966:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+8:14423:x1871641503189760:12345-192.168.204.1@tcp:36:lfs.0 00010000:00010000:0.0:1784936837.379021:0:14232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936837.379047:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6db9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951b6 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.379065:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9096caf90500) 00010000:00010000:0.0:1784936837.379075:0:14232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936837.379097:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.379109:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.379119:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936837.379371:0:14232:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8c7f2a6 reply state 00000000b17f4969 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936837.379381:0:14232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784936837.379395:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1784936837.379702:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+9:14423:x1871641503189760:12345-192.168.204.1@tcp:36:lfs.0 Request processed in 735us (914us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784936837.379709:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 24 00010000:00010000:3.0:1784936837.382482:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.382626:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.382635:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.382642:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936837.382647:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.382669:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.382686:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9096caf90a00) 00010000:00010000:3.0:1784936837.382689:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784936837.382694:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.382701:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a800/0x6cf7a864723f6dce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.383743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.383827:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503190016 00000100:00100000:2.0:1784936837.383837:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503190016 00000100:00100000:2.0:1784936837.383900:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1784936837.383910:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+8:14423:x1871641503190016:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936837.384168:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+9:14423:x1871641503190016:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 259us (431us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784936837.384177:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:1.0:1784936837.391328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.391593:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503190272 00000100:00100000:2.0:1784936837.391605:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503190272 00000100:00100000:2.0:1784936837.391674:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:2.0:1784936837.391684:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+9:14423:x1871641503190272:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936837.391709:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.391729:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951c4 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.391806:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.391837:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.391850:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.391881:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.391890:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.391898:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.392039:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784936837.392135:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392142:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392148:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392154:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.392159:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392167:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392189:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:2.0:1784936837.392192:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.392197:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392204:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392220:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392227:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392233:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392239:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.392242:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392248:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392255:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9096c6420400) 00010000:00010000:2.0:1784936837.392257:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.392262:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392268:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392316:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951c4 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392327:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:2.0:1784936837.392329:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936837.392333:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951c4 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.392356:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e200, rc 0) 00000100:00100000:2.0:1784936837.392423:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+10:14423:x1871641503190272:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 740us (1103us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1784936837.392479:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:0.0:1784936837.397217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.397292:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503190400 00000100:00100000:3.0:1784936837.397302:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503190400 00000100:00100000:3.0:1784936837.397367:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:3.0:1784936837.397384:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+10:14423:x1871641503190400:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936837.397409:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936837.397464:0:14234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6df1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951cb expref: -99 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.397558:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.397571:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.397583:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936837.397629:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784936837.397643:0:14234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784936837.397683:0:14234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.397709:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6df1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 12 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.397736:0:14234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 11 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.397745:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90970053a900) 00010000:00010000:3.0:1784936837.397748:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784936837.397751:0:14234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b000, rc 0) 00000100:00100000:3.0:1784936837.397805:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:14423:x1871641503190400:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 430us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936837.397811:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:3.0:1784936837.404010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.404730:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503190528 00000100:00100000:2.0:1784936837.404741:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503190528 00000100:00100000:2.0:1784936837.404842:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:2.0:1784936837.404853:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:14423:x1871641503190528:12345-192.168.204.1@tcp:37:lfs.0 00000100:00100000:2.0:1784936837.418106:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:14423:x1871641503190528:12345-192.168.204.1@tcp:37:lfs.0 Request processed in 13245us (14096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.418122:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:1.0:1784936837.428141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.428421:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503190784 00000100:00100000:2.0:1784936837.428514:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503190784 00000100:00100000:2.0:1784936837.428583:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:2.0:1784936837.428599:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff888050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:14423:x1871641503190784:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936837.429265:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff888050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+12:14423:x1871641503190784:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 665us (1139us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784936837.429292:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1784936837.489629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.489824:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503190912 00000100:00100000:2.0:1784936837.489835:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503190912 00000100:00100000:2.0:1784936837.489899:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:2.0:1784936837.489911:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+10:14429:x1871641503190912:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936837.489933:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.489955:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951d2 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490028:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490135:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490149:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490164:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490172:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490178:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490287:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6e14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490313:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6e14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490321:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6e14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.490365:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784936837.490369:0:14233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936837.490414:0:14233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6e14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490525:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490534:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490541:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490547:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.490551:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490559:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490571:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:2.0:1784936837.490574:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.490578:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490594:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e000/0x6cf7a864723f6e06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490607:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490614:0:14233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490620:0:14233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490625:0:14233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.490628:0:14233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490633:0:14233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490639:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9096c6420400) 00010000:00010000:2.0:1784936837.490642:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.490644:0:14233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490650:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490681:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d2 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490707:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e800/0x6cf7a864723f6e14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d2 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.490896:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90970053a900) 00010000:00010000:2.0:1784936837.490900:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784936837.490904:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e800, rc 0) 00000100:00100000:2.0:1784936837.491081:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+11:14429:x1871641503190912:12345-192.168.204.1@tcp:101:bash.0 Request processed in 1171us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.491089:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 27 00000100:00100000:1.0:1784936837.500096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936837.500204:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503191168 00000100:00100000:0.0:1784936837.500215:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503191168 00000100:00100000:0.0:1784936837.500274:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 28 00000100:00100000:0.0:1784936837.500285:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+11:14429:x1871641503191168:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:0.0:1784936837.500307:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936837.500329:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6e1b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951d9 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.500496:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.500510:0:14232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 11 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.500519:0:14232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.500551:0:14232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 11 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.500584:0:14232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 11 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936837.500598:0:14232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f4a9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1871641524148608:192.168.204.1@tcp:104: 00000100:00100000:0.0:1784936837.500701:0:14232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936837.503060:0:14232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f4a9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1871641524148608:192.168.204.1@tcp:104: 00010000:00010000:0.0:1784936837.503094:0:14232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936837.503680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.503780:0:14219:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503191296 00000100:00100000:2.0:1784936837.503789:0:14219:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503191296 00010000:00010000:2.0:1784936837.503825:0:14219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 12 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.503869:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:2.0:1784936837.503879:0:14219:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+12:2372:x1871641503191296:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936837.503905:0:14219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936837.503913:0:14219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 12 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.503928:0:14219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 12 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.503950:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6df8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951cb expref: 12 pid: 14234 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.503989:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90970053a900) 00010000:00010000:2.0:1784936837.503994:0:14219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.504024:0:14219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.504033:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.504065:0:14219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936837.504101:0:14232:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.504110:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.504128:0:14219:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:2372:x1871641503191296:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 250us (449us total) trans 0 rc 0/0 00010000:00010000:0.0:1784936837.504132:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.504141:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00010000:00010000:0.0:1784936837.504145:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.504154:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.504994:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505006:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505022:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936837.505034:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784936837.505064:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505072:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505078:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505083:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936837.505087:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505094:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505104:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90970053a900) 00010000:00010000:0.0:1784936837.505107:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936837.505110:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505123:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26b400/0x6cf7a864723f6e22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936837.505135:0:14232:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2a7cf9f reply state 0000000051168e12 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936837.505154:0:14232:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784936837.505192:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ac00/0x6cf7a864723f6e1b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 14 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505215:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 13 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936837.505222:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:0.0:1784936837.505225:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1784936837.505228:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26be00, rc 0) 00000100:00100000:0.0:1784936837.505282:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+14:14429:x1871641503191168:12345-192.168.204.1@tcp:101:bash.0 Request processed in 4999us (5196us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1784936837.505290:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 28 00010000:00010000:2.0:1784936837.519588:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.519607:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.519615:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.519621:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26a200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.519627:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.519634:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.519671:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9096caf90500) 00010000:00010000:2.0:1784936837.519675:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936837.519680:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.519686:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26a200/0x6cf7a864723f6e29 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.524370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.524475:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503191424 00000100:00100000:2.0:1784936837.524486:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503191424 00000100:00100000:2.0:1784936837.524539:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:2.0:1784936837.524548:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+13:14429:x1871641503191424:12345-192.168.204.1@tcp:101:bash.0 00010000:00010000:2.0:1784936837.524573:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.524595:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951e0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524658:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524672:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524684:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.524733:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784936837.524737:0:14233:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784936837.524757:0:14233:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524787:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524813:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 15 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524832:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 14 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.524842:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936837.524845:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784936837.524848:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e400, rc 0) 00000100:00100000:2.0:1784936837.524909:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+14:14429:x1871641503191424:12345-192.168.204.1@tcp:101:bash.0 Request processed in 361us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.524917:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 29 00000100:00100000:1.0:1784936837.530742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.530998:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503191680 00000100:00100000:3.0:1784936837.531008:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503191680 00000100:00100000:3.0:1784936837.531109:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1784936837.531119:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72410603-668c-4b8f-a839-7098c5dcbd21+14:14429:x1871641503191680:12345-192.168.204.1@tcp:35:bash.0 00000100:00100000:3.0:1784936837.531805:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72410603-668c-4b8f-a839-7098c5dcbd21+15:14429:x1871641503191680:12345-192.168.204.1@tcp:35:bash.0 Request processed in 685us (1071us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1784936837.531815:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00010000:00010000:1.0:1784936837.577602:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936837.623325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.623479:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503191936 00000100:00100000:2.0:1784936837.623491:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503191936 00000100:00100000:2.0:1784936837.623555:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:2.0:1784936837.623566:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+15:14439:x1871641503191936:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:2.0:1784936837.623591:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.623612:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951e7 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784936837.623759:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784936837.624204:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e7 expref: 17 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.624239:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90970053a600) 00010000:00010000:2.0:1784936837.624242:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936837.624247:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e7 expref: 17 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.624262:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e200, rc 0) 00000100:00100000:2.0:1784936837.624477:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+16:14439:x1871641503191936:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 911us (1163us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1784936837.624486:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 30 00000100:00100000:0.0:1784936837.628937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.629070:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503192192 00000100:00100000:2.0:1784936837.629080:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503192192 00000100:00100000:2.0:1784936837.629149:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:2.0:1784936837.629159:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+16:14439:x1871641503192192:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936837.629490:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+17:14439:x1871641503192192:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 330us (562us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784936837.629498:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:1.0:1784936837.670000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.670114:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503192448 00000100:00100000:3.0:1784936837.670126:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503192448 00000100:00100000:3.0:1784936837.670210:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:3.0:1784936837.670221:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+17:14442:x1871641503192448:12345-192.168.204.1@tcp:101:lfs.0 00010000:00010000:3.0:1784936837.670249:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936837.670272:0:14234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e5a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951ee expref: -99 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.670390:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.670404:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.670417:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936837.670451:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784936837.670581:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e5a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951ee expref: 20 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.670600:0:14234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951ee expref: 19 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.670609:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936837.670612:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936837.670615:0:14234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b600, rc 0) 00000100:00100000:3.0:1784936837.670961:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+19:14442:x1871641503192448:12345-192.168.204.1@tcp:101:lfs.0 Request processed in 741us (970us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784936837.670968:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 31 00000100:00100000:0.0:1784936837.679110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936837.679150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.679220:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503192704 00000100:00100000:3.0:1784936837.679243:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503192704 00000100:00100000:3.0:1784936837.679310:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:3.0:1784936837.679320:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72410603-668c-4b8f-a839-7098c5dcbd21+19:2373:x1871641503192704:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936837.679335:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936837.679371:0:14218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951ee expref: 19 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.679393:0:14218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936837.679398:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936837.679470:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72410603-668c-4b8f-a839-7098c5dcbd21+18:2373:x1871641503192704:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936837.679477:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1784936837.679865:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503192576 00000100:00100000:2.0:1784936837.679871:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503192576 00000100:00100000:2.0:1784936837.679909:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:2.0:1784936837.679916:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+18:14442:x1871641503192576:12345-192.168.204.1@tcp:54:lfs.0 00010000:00010000:2.0:1784936837.679978:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.679992:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680015:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680043:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680049:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680056:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680062:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936837.680066:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680074:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680084:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936837.680086:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784936837.680090:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.680095:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6e6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.680139:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+18:14442:x1871641503192576:12345-192.168.204.1@tcp:54:lfs.0 Request processed in 223us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.680145:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 32 00000100:00100000:0.0:1784936837.683053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.683365:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503192960 00000100:00100000:2.0:1784936837.683375:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503192960 00000100:00100000:2.0:1784936837.683450:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:2.0:1784936837.683460:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+18:14442:x1871641503192960:12345-192.168.204.1@tcp:35:lfs.0 00000100:00100000:2.0:1784936837.684140:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+19:14442:x1871641503192960:12345-192.168.204.1@tcp:35:lfs.0 Request processed in 679us (1092us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784936837.684150:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1784936837.895459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.895591:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503193216 00000100:00100000:3.0:1784936837.895599:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503193216 00000100:00100000:3.0:1784936837.895701:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 33 00000100:00100000:3.0:1784936837.895712:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+19:14473:x1871641503193216:12345-192.168.204.1@tcp:101:cat.0 00010000:00010000:3.0:1784936837.895735:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936837.895756:0:14234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e76 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951f5 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.895867:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.895884:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.895896:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936837.895923:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784936837.896032:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e76 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951f5 expref: 22 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.896046:0:14234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951f5 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.896052:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936837.896054:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784936837.896056:0:14234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165a400, rc 0) 00000100:00100000:3.0:1784936837.896103:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+21:14473:x1871641503193216:12345-192.168.204.1@tcp:101:cat.0 Request processed in 395us (685us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1784936837.896107:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 33 00000040:00080000:0.0:1784936837.897031:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784936837.898645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.898789:0:14220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503193344 00000100:00100000:2.0:1784936837.898799:0:14220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503193344 00000100:00100000:2.0:1784936837.898866:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:2.0:1784936837.898876:0:14220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72410603-668c-4b8f-a839-7098c5dcbd21+21:2371:x1871641503193344:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936837.898892:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936837.898918:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6e7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951f5 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.898936:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936837.898941:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936837.898996:0:14220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72410603-668c-4b8f-a839-7098c5dcbd21+20:2371:x1871641503193344:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.899003:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:0.0:1784936837.899935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.900113:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503193600 00000100:00100000:2.0:1784936837.900120:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503193600 00000100:00100000:2.0:1784936837.900195:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:2.0:1784936837.900204:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+20:14473:x1871641503193600:12345-192.168.204.1@tcp:35:cat.0 00000100:00100000:2.0:1784936837.900580:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+21:14473:x1871641503193600:12345-192.168.204.1@tcp:35:cat.0 Request processed in 375us (647us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784936837.900603:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 8 00000100:00100000:0.0:1784936837.956992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.958871:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503193856 00000100:00100000:3.0:1784936837.958884:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503193856 00000100:00100000:3.0:1784936837.961083:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:3.0:1784936837.961108:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+21:14479:x1871641503193856:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:3.0:1784936837.961137:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784936837.961161:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e8b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c951fc expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.961264:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.961279:0:14233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 22 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.961305:0:14233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 22 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.961314:0:14233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.961360:0:14233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 22 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.961377:0:14233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 22 pid: 14233 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.961392:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1871641524148736:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936837.963203:0:14233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 22 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.963220:0:14233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 22 pid: 14232 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.963234:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1871641524148864:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936837.963261:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784936837.966698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936837.966742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.966910:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1871641524148736:192.168.204.1@tcp:104: 00000100:00100000:3.0:1784936837.966923:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1871641524148864:192.168.204.1@tcp:104: 00010000:00010000:3.0:1784936837.966949:0:14233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.967121:0:16252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503193984 00000100:00100000:2.0:1784936837.967129:0:16252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503193984 00010000:00010000:2.0:1784936837.967166:0:16252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 23 pid: 14233 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.967201:0:16252:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503194112 00000100:00100000:2.0:1784936837.967205:0:16252:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503194112 00010000:00010000:2.0:1784936837.967218:0:16252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 24 pid: 14232 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936837.967253:0:16252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:2.0:1784936837.967263:0:16252:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff875850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72410603-668c-4b8f-a839-7098c5dcbd21+24:2371:x1871641503193984:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936837.967278:0:16252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936837.967296:0:16252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 24 pid: 14233 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.967361:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:3.0:1784936837.967369:0:14219:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72410603-668c-4b8f-a839-7098c5dcbd21+24:2371:x1871641503194112:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936837.967379:0:14219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936837.967385:0:14219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 24 pid: 14232 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.967395:0:14219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 24 pid: 14232 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.967461:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6e30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951d9 expref: 24 pid: 14232 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.967479:0:16252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 23 pid: 14233 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.967612:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936837.967618:0:14219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.967627:0:14219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.967633:0:14219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936837.967639:0:16252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e400/0x6cf7a864723f6e45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951e0 expref: 23 pid: 14233 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.967649:0:16252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936837.967652:0:16252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.967716:0:14219:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72410603-668c-4b8f-a839-7098c5dcbd21+22:2371:x1871641503194112:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 347us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936837.967725:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00010000:00010000:2.0:1784936837.967733:0:16252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.967740:0:16252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.967766:0:16252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936837.967799:0:16252:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff875850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72410603-668c-4b8f-a839-7098c5dcbd21+21:2371:x1871641503193984:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 538us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.967805:0:16252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00010000:00010000:3.0:1784936837.968164:0:14233:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.968172:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784936837.968197:0:14233:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784936837.968551:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b600/0x6cf7a864723f6e8b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951fc expref: 22 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.968568:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165b000/0x6cf7a864723f6e92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c951fc expref: 21 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.968575:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936837.968577:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784936837.968579:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c165b000, rc 0) 00000100:00100000:3.0:1784936837.968611:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+21:14479:x1871641503193856:12345-192.168.204.1@tcp:101:dd.0 Request processed in 7516us (11628us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1784936837.968618:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 34 00000100:00100000:0.0:1784936837.971362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.971410:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503194368 00000100:00100000:3.0:1784936837.971420:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503194368 00000100:00100000:3.0:1784936837.971574:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 35 00000100:00100000:3.0:1784936837.971585:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+21:14479:x1871641503194368:12345-192.168.204.1@tcp:36:dd.0 00010000:00010000:3.0:1784936837.971872:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.971888:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.971908:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784936837.971962:0:14234:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1784936837.972007:0:14234:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080e2d8fb reply state 000000009f5fa575 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936837.972017:0:14234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784936837.972094:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+24:14479:x1871641503194368:12345-192.168.204.1@tcp:36:dd.0 Request processed in 511us (739us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1784936837.972101:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 35 00000020:00080000:3.0:1784936837.972105:0:14234:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784936837.975990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.976069:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503194496 00000100:00100000:2.0:1784936837.976079:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503194496 00000100:00100000:2.0:1784936837.976208:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 36 00000100:00100000:2.0:1784936837.976219:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+24:14479:x1871641503194496:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:2.0:1784936837.976243:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936837.976261:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6ea7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95203 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.976325:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95203 expref: 25 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.976350:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95203 expref: 25 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.976368:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936837.976371:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784936837.976374:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e200, rc 0) 00000100:00100000:2.0:1784936837.976446:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+25:14479:x1871641503194496:12345-192.168.204.1@tcp:101:dd.0 Request processed in 229us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.976453:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 36 00010000:00010000:3.0:1784936837.977051:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.977061:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.977068:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.977074:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165a400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936837.977078:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.977085:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.977096:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936837.977099:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936837.977103:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.977109:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6ea0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936837.995381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936837.995524:0:14220:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503194752 00000100:00100000:2.0:1784936837.995534:0:14220:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503194752 00000100:00100000:2.0:1784936837.995642:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:2.0:1784936837.995653:0:14220:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72410603-668c-4b8f-a839-7098c5dcbd21+24:14479:x1871641503194752:12345-192.168.204.1@tcp:103:dd.0 00010000:00010000:2.0:1784936837.995682:0:14220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936837.995708:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6ea7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95203 expref: 24 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936837.995727:0:14220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936837.995731:0:14220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784936837.995785:0:14220:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72410603-668c-4b8f-a839-7098c5dcbd21+23:14479:x1871641503194752:12345-192.168.204.1@tcp:103:dd.0 Request processed in 134us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936837.995793:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:0.0:1784936837.997996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936837.998094:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503194880 00000100:00100000:3.0:1784936837.998116:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503194880 00000100:00100000:3.0:1784936837.998201:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:3.0:1784936837.998211:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+23:14479:x1871641503194880:12345-192.168.204.1@tcp:58:dd.0 00010000:00010000:3.0:1784936837.998317:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.998343:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936837.998356:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784936837.999470:0:14234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784936837.999642:0:14234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1784936838.000171:0:14234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1784936838.000352:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+23:14479:x1871641503194880:12345-192.168.204.1@tcp:58:dd.0 Request processed in 2137us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936838.000364:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 37 00000100:00100000:0.0:1784936838.007247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936838.007363:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195008 00000100:00100000:2.0:1784936838.007373:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195008 00000100:00100000:2.0:1784936838.007486:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:2.0:1784936838.007495:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+23:14479:x1871641503195008:12345-192.168.204.1@tcp:101:dd.0 00010000:00010000:2.0:1784936838.007516:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784936838.007535:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9520a expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.007592:0:14233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.007603:0:14233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 24 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.007634:0:14233:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.007649:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 24 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.007662:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:2.0:1784936838.007665:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784936838.007669:0:14233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 24 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.007677:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096f7f4e200, rc 0) 00000100:00100000:2.0:1784936838.007801:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+24:14479:x1871641503195008:12345-192.168.204.1@tcp:101:dd.0 Request processed in 306us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.007808:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 38 00000100:00100000:3.0:1784936838.026202:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524149120:0@lo:400:kworker.0 00000100:00100000:3.0:1784936838.026266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936838.026293:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524149632:0@lo:400:kworker.0 00000100:00100000:3.0:1784936838.026316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936838.026352:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784936838.026358:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524149248:0@lo:400:kworker.0 00000100:00100000:3.0:1784936838.026381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784936838.026444:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149632 00000100:00100000:3.0:1784936838.026450:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149632 00000100:00100000:3.0:1784936838.026497:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784936838.026507:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524149632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784936838.026561:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1871641524149632:12345-0@lo:400:kworker.0 Request processed in 56us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936838.026569:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784936838.026607:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1871641524149632:0@lo:400:kworker.0 00000100:00080000:0.0:1784936838.026804:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936838.026940:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524148992:0@lo:400:kworker.0 00000100:00100000:1.0:1784936838.026974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936838.027018:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524149504:0@lo:400:kworker.0 00000100:00100000:1.0:1784936838.027045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936838.027068:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784936838.027073:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ede57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524149376:0@lo:400:kworker.0 00000100:00100000:1.0:1784936838.027094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936838.027121:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524149760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784936838.027145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936838.027176:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149120 00000100:00100000:1.0:1784936838.027180:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149120 00000100:00100000:1.0:1784936838.027211:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149248 00000100:00100000:1.0:1784936838.027214:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149248 00000100:00100000:1.0:1784936838.027233:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784936838.027239:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524149120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936838.027278:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4667800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524149120:12345-0@lo:400:kworker.0 Request processed in 39us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936838.027284:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784936838.027297:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784936838.027302:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524149248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936838.027347:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1871641524149248:12345-0@lo:400:kworker.0 Request processed in 44us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936838.027353:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784936838.027391:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524148992 00000100:00100000:1.0:1784936838.027402:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524148992 00000100:00100000:1.0:1784936838.027450:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784936838.027457:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3308:x1871641524148992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784936838.027495:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8567782c-cd42-40bd-85ed-bd4db0d07a3f+19:3308:x1871641524148992:12345-0@lo:400:kworker.0 Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936838.027501:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1784936838.028121:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784936838.028126:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784936838.029179:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149760 00000100:00100000:2.0:1784936838.029188:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149760 00000100:00100000:2.0:1784936838.029229:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784936838.029301:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524149760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784936838.029343:0:14873:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936838.029415:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1871641524149760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.029421:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784936838.029614:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1871641524149760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784936838.029642:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149504 00000100:00100000:2.0:1784936838.029653:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149504 00000100:00100000:2.0:1784936838.029683:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149376 00000100:00100000:2.0:1784936838.029686:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149376 00000100:00100000:2.0:1784936838.029699:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784936838.029721:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524149504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936838.029757:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1871641524149504:12345-0@lo:400:kworker.0 Request processed in 52us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.029763:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784936838.029775:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784936838.029782:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524149376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784936838.029809:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1871641524149376:12345-0@lo:400:kworker.0 Request processed in 29us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.029815:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784936838.029898:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1871641524149376:0@lo:400:kworker.0 00000100:00100000:2.0:1784936838.029910:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8567782c-cd42-40bd-85ed-bd4db0d07a3f:3308:1871641524148992:0@lo:400:kworker.0 00000100:00100000:2.0:1784936838.029920:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ff425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1871641524149504:0@lo:400:kworker.0 00000100:00100000:3.0:1784936838.030123:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524149248:0@lo:400:kworker.0 00000100:00100000:3.0:1784936838.030135:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ede54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1871641524149120:0@lo:400:kworker.0 00000100:00080000:0.0:1784936838.030825:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784936838.536769:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524149888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784936838.536845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784936838.537124:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524149888 00000100:00100000:2.0:1784936838.537134:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524149888 00000100:00100000:2.0:1784936838.537190:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784936838.537200:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524149888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784936838.537238:0:14873:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784936838.537295:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1871641524149888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.537302:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784936838.537399:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1871641524149888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784936838.581408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936838.581536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936838.581568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936838.581593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936838.581609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936838.581624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936838.581681:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195520 00000100:00100000:0.0:1784936838.581690:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195520 00000100:00100000:0.0:1784936838.581745:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195776 00000100:00100000:0.0:1784936838.581747:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195776 00000100:00100000:0.0:1784936838.581759:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195392 00000100:00100000:0.0:1784936838.581761:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195392 00000100:00100000:0.0:1784936838.581774:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1784936838.581782:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2373:x1871641503195520:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936838.581851:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2373:x1871641503195520:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.581858:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1784936838.581872:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1784936838.581877:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2373:x1871641503195776:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936838.581897:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2373:x1871641503195776:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 20us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.581902:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1784936838.581911:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:0.0:1784936838.581916:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2373:x1871641503195392:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936838.581934:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+5:2373:x1871641503195392:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 17us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.581957:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00080000:0.0:1784936838.582055:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784936838.582060:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784936838.582133:0:14227:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195136 00000100:00100000:0.0:1784936838.582137:0:14227:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195136 00000100:00100000:0.0:1784936838.582165:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:0.0:1784936838.582172:0:14227:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096e8d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:2373:x1871641503195136:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936838.582205:0:14227:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096e8d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01ea0ce2-4f07-4ea4-ac68-d123b6a2291c+13:2373:x1871641503195136:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 33us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.582212:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 121 00000100:00100000:2.0:1784936838.586919:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195264 00000100:00100000:2.0:1784936838.586950:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195264 00000100:00100000:2.0:1784936838.599358:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195648 00000100:00100000:2.0:1784936838.599374:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195648 00000100:00100000:2.0:1784936838.599453:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:2.0:1784936838.599465:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096d4666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+24:2373:x1871641503195264:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:1.0:1784936838.599780:0:14232:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784936838.599781:0:14234:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784936838.599796:0:14234:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784936838.599949:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:2.0:1784936838.599981:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096d4666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+24:2373:x1871641503195264:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 517us (18581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.599991:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 25 00000100:00100000:0.0:1784936838.600095:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:2373:x1871641503195648:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936838.600141:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+11:2373:x1871641503195648:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 52us (18514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.600148:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 26 00000100:00100000:3.0:1784936838.600604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00010000:00010000:1.0:1784936838.600743:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784936838.600746:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503195904 00000100:00100000:0.0:1784936838.600753:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503195904 00000100:00100000:0.0:1784936838.600809:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:0.0:1784936838.600817:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2373:x1871641503195904:12345-192.168.204.1@tcp:400:kworker.0 00000100:00100000:0.0:1784936838.600855:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee7ee7fc-b827-4d2a-a16d-2454533e0d7b+5:2373:x1871641503195904:12345-192.168.204.1@tcp:400:kworker.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.600862:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00080000:1.0:1784936838.601200:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1784936838.921720:0:14266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784936838.921741:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784936838.921799:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784936838.921807:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1784936838.921948:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14266:1871641524150016:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784936838.922285:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784936838.929374:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096f5040380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14266:1871641524150016:192.168.204.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784936838.932236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936838.935081:0:14243:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503196032 00000100:00100000:2.0:1784936838.935097:0:14243:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503196032 00000100:00100000:2.0:1784936838.935174:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:2.0:1784936838.935185:0:14243:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196032:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784936838.935284:0:14243:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196032:12345-192.168.204.1@tcp:900:lhsmtool_posix.0 Request processed in 101us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.935293:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:0.0:1784936838.944223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936838.944348:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503196160 00000100:00100000:1.0:1784936838.944360:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503196160 00000100:00100000:1.0:1784936838.944466:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:1.0:1784936838.944478:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096f5041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196160:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784936838.944514:0:14232:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784936838.944620:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096f5041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196160:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 144us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936838.944627:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 39 00000100:00100000:3.0:1784936838.957169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936838.957309:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503196288 00000100:00100000:0.0:1784936838.957331:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503196288 00000100:00100000:0.0:1784936838.957397:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:0.0:1784936838.957407:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196288:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784936838.957544:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957562:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957573:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957587:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957595:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957602:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957624:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957647:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957656:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784936838.957694:0:14234:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784936838.957698:0:14234:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784936838.957712:0:14234:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957723:0:14234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957729:0:14234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957737:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957743:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26be00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936838.957746:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957754:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957766:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c6420b00) 00010000:00010000:0.0:1784936838.957769:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936838.957774:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957791:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26be00/0x6cf7a864723f6ebc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957807:0:14234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957813:0:14234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957819:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957823:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936838.957826:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957832:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957840:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9096caf90100) 00010000:00010000:0.0:1784936838.957843:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936838.957846:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957851:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6ec3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957865:0:14234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957871:0:14234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957882:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957887:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26ba00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:0.0:1784936838.957890:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957897:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957904:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:0.0:1784936838.957907:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784936838.957910:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936838.957916:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26ba00/0x6cf7a864723f6eca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936838.958014:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196288:12345-192.168.204.1@tcp:34:lhsmtool_posix.0 Request processed in 608us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936838.958023:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 40 00000100:00100000:2.0:1784936838.964085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936838.964371:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503196544 00000100:00100000:1.0:1784936838.964383:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503196544 00000100:00100000:1.0:1784936838.964487:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:1.0:1784936838.964498:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+24:14480:x1871641503196544:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936838.964524:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936838.964546:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ed1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95211 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964671:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964686:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964697:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936838.964707:0:14232:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784936838.964812:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964820:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964826:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964831:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165000 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936838.964835:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964844:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964857:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:1.0:1784936838.964859:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784936838.964865:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964882:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6ed8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964930:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ed1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95211 expref: 26 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964941:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9096c6420b00) 00010000:00010000:1.0:1784936838.964944:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784936838.964948:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ed1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95211 expref: 26 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.964957:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:1.0:1784936838.965033:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+25:14480:x1871641503196544:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 537us (958us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1784936838.965041:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 41 00000100:00100000:0.0:1784936838.968930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936838.969088:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503196672 00000100:00100000:2.0:1784936838.969098:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503196672 00000100:00100000:2.0:1784936838.969163:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:2.0:1784936838.969174:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+25:14480:x1871641503196672:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784936838.969215:0:14234:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784936838.969339:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+25:14480:x1871641503196672:12345-192.168.204.1@tcp:53:lhsmtool_posix.0 Request processed in 166us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936838.969346:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 42 00000100:00100000:3.0:1784936838.980296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936838.980400:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503196928 00000100:00100000:1.0:1784936838.980410:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503196928 00000100:00100000:1.0:1784936838.980495:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:1.0:1784936838.980505:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+25:14480:x1871641503196928:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936838.980526:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936838.980546:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ee6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95218 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784936838.981243:0:14232:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1784936838.981250:0:14232:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1784936838.981301:0:14232:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1784936838.981640:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6eed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.981662:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.981673:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.981737:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6ee6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95218 expref: 28 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.981755:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6eed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95218 expref: 27 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.981764:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246600) 00010000:00010000:1.0:1784936838.981767:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784936838.981771:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165000, rc 0) 00000100:00100000:1.0:1784936838.981843:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+27:14480:x1871641503196928:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 1337us (1553us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1784936838.981851:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 43 00000100:00100000:3.0:1784936838.986044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936838.986467:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503197184 00000100:00100000:2.0:1784936838.986478:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503197184 00000100:00100000:2.0:1784936838.986548:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:2.0:1784936838.986559:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+27:14480:x1871641503197184:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784936838.986621:0:14234:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936838.986650:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165000/0x6cf7a864723f6eed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95218 expref: 27 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986668:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246600) 00010000:00010000:2.0:1784936838.986680:0:14234:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784936838.986702:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986715:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986724:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986737:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986743:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986748:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986831:0:14234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986838:0:14234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986855:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986861:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4fc00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936838.986865:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986871:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986880:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90970053a900) 00010000:00010000:2.0:1784936838.986883:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936838.986887:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986893:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4fc00/0x6cf7a864723f6efb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986902:0:14234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986907:0:14234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986912:0:14234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986917:0:14234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936838.986919:0:14234:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986934:0:14234:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986941:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe7a303e6 (ffff9096c6420400) 00010000:00010000:2.0:1784936838.986943:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784936838.986946:0:14234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.986951:0:14234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f02 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe7a303e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936838.987051:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+26:14480:x1871641503197184:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 493us (1017us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784936838.987059:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 44 00000100:00100000:3.0:1784936838.989071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936838.989521:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503197312 00000100:00100000:1.0:1784936838.989532:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503197312 00000100:00100000:1.0:1784936838.989594:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:1.0:1784936838.989604:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+26:14480:x1871641503197312:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936838.989624:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936838.989646:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f09 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9521f expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.989682:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f6f10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.989708:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f6f10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.989720:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f6f10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.989828:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9521f expref: 28 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.989845:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165800/0x6cf7a864723f6f10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9521f expref: 27 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936838.989854:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:1.0:1784936838.989857:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784936838.989861:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165800, rc 0) 00000100:00100000:1.0:1784936838.989951:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+27:14480:x1871641503197312:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 347us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936838.989958:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 45 00000100:00100000:3.0:1784936838.995922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936838.996057:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503197568 00000100:00100000:2.0:1784936838.996067:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503197568 00000100:00100000:2.0:1784936838.996132:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 46 00000100:00100000:2.0:1784936838.996143:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+27:14480:x1871641503197568:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784936838.996227:0:14234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.996243:0:14234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.996254:0:14234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784936838.996698:0:14234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1784936838.996709:0:14234:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504748279920ns, next at 505748278019ns, rc = 0 00000004:00010000:2.0:1784936838.996820:0:14234:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af22349e reply state 00000000be1f7d17 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936838.996831:0:14234:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784936838.996938:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+29:14480:x1871641503197568:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 796us (1024us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1784936838.996945:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 46 00010000:00010000:2.0:1784936838.998871:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.998888:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.998895:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.998901:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e600 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:2.0:1784936838.998905:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.998912:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.998930:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:2.0:1784936838.998933:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784936838.998938:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936838.998944:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e600/0x6cf7a864723f6f17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.001424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.001553:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503197696 00000100:00100000:1.0:1784936839.001566:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503197696 00000100:00100000:1.0:1784936839.001643:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00100000:1.0:1784936839.001653:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+28:14480:x1871641503197696:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936839.001676:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936839.001697:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95226 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.001757:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 29 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.001784:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 29 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.001811:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:1.0:1784936839.001815:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784936839.001819:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8164c00, rc 0) 00000100:00100000:1.0:1784936839.001874:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+29:14480:x1871641503197696:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 223us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936839.001881:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 47 00000100:00080000:0.0:1784936839.001948:0:14228:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784936839.008020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.008118:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503197824 00000100:00100000:0.0:1784936839.008129:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503197824 00000100:00100000:0.0:1784936839.008191:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:0.0:1784936839.008201:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72410603-668c-4b8f-a839-7098c5dcbd21+5:2371:x1871641503197824:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784936839.008636:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72410603-668c-4b8f-a839-7098c5dcbd21+6:2371:x1871641503197824:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 435us (624us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1784936839.008661:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 12 00000100:00100000:3.0:1784936839.014788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.014900:0:14236:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503198080 00000100:00100000:2.0:1784936839.014924:0:14236:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503198080 00000100:00100000:2.0:1784936839.014988:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:2.0:1784936839.014999:0:14236:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72410603-668c-4b8f-a839-7098c5dcbd21+29:14480:x1871641503198080:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784936839.015260:0:14236:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72410603-668c-4b8f-a839-7098c5dcbd21+30:14480:x1871641503198080:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 262us (482us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784936839.015268:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 9 00000100:00100000:3.0:1784936839.021277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.021482:0:14234:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503198336 00000100:00100000:2.0:1784936839.021491:0:14234:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503198336 00000100:00100000:2.0:1784936839.021557:0:14234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:2.0:1784936839.021568:0:14234:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+30:14480:x1871641503198336:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784936839.021915:0:14234:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72410603-668c-4b8f-a839-7098c5dcbd21+30:14480:x1871641503198336:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 348us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936839.021924:0:14234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 48 00000100:00100000:3.0:1784936839.026410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.026690:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503198464 00000100:00100000:1.0:1784936839.026701:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503198464 00000100:00100000:1.0:1784936839.026823:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:1.0:1784936839.026834:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+30:14480:x1871641503198464:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784936839.026856:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784936839.026878:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f25 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c9522d expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.026953:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6f2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.026967:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.026980:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784936839.027017:0:14232:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784936839.027053:0:14232:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.027079:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f25 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9522d expref: 32 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.027098:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9522d expref: 31 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.027108:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:1.0:1784936839.027111:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784936839.027115:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096c8165600, rc 0) 00000100:00100000:1.0:1784936839.027182:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+31:14480:x1871641503198464:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 349us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936839.027190:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 49 00000100:00100000:3.0:1784936839.031272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.031372:0:16013:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503198592 00000100:00100000:0.0:1784936839.031381:0:16013:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503198592 00000100:00100000:0.0:1784936839.031462:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:0.0:1784936839.031662:0:16013:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+6:2372:x1871641503198592:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784936839.031683:0:16013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784936839.031713:0:16013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdb594e5d35c95234 expref: -99 pid: 16013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784936839.031741:0:16013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63f987, blocks: 0x1 00010000:00010000:0.0:1784936839.031761:0:16013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1784936839.031766:0:16013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936839.031777:0:16013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 7 pid: 16013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.031796:0:16013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 7 pid: 16013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.031810:0:16013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9096ee26ba00, rc 0) 00000100:00100000:0.0:1784936839.031871:0:16013:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72410603-668c-4b8f-a839-7098c5dcbd21+7:2372:x1871641503198592:12345-192.168.204.1@tcp:101:lhsmtool_posix.0 Request processed in 214us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936839.031878:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:3.0:1784936839.035222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.035352:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503198848 00000100:00100000:0.0:1784936839.035365:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503198848 00000100:00100000:0.0:1784936839.035470:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:0.0:1784936839.035486:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+31:14480:x1871641503198848:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784936839.035618:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+31:14480:x1871641503198848:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 134us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784936839.035626:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 50 00000100:00100000:3.0:1784936839.037660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.037817:0:16365:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503198976 00000100:00100000:2.0:1784936839.037826:0:16365:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503198976 00000100:00100000:2.0:1784936839.037931:0:16365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:2.0:1784936839.037941:0:16365:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72410603-668c-4b8f-a839-7098c5dcbd21+31:14480:x1871641503198976:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784936839.085820:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:1.0:1784936839.085837:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1784936839.086027:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1784936839.086039:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1784936839.086045:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784936839.086151:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1784936839.086472:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524150144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784936839.086544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936839.086778:0:14868:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524150144 00000100:00100000:1.0:1784936839.086786:0:14868:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524150144 00000100:00100000:1.0:1784936839.086840:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784936839.086850:0:14868:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1871641524150144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1784936839.087022:0:14868:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784936839.087026:0:14868:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1784936839.087028:0:14868:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784936839.087031:0:14868:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784936839 -> 1784936839 00002000:00010000:1.0:1784936839.087047:0:14868:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784936839.087418:0:16365:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72410603-668c-4b8f-a839-7098c5dcbd21+14:14480:x1871641503198976:12345-192.168.204.1@tcp:44:lhsmtool_posix.0 Request processed in 49476us (49762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936839.087449:0:16365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 51 00000100:00100000:0.0:1784936839.091212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.091386:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503199104 00000100:00100000:2.0:1784936839.091397:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503199104 00000100:00100000:2.0:1784936839.091463:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:2.0:1784936839.091474:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72410603-668c-4b8f-a839-7098c5dcbd21+7:2371:x1871641503199104:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1784936839.091585:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72410603-668c-4b8f-a839-7098c5dcbd21+7:2371:x1871641503199104:12345-192.168.204.1@tcp:16:lhsmtool_posix.0 Request processed in 113us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936839.091798:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 15 00000100:00100000:1.0:1784936839.094572:0:14868:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1871641524150144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7713us (8016us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1784936839.094593:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1784936839.095837:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9096c8a3e300/2, rc 0, transno 8589934595 00000100:00100000:3.0:1784936839.095850:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096c8a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1871641524150144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784936839.096401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.096516:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503199360 00000100:00100000:0.0:1784936839.096524:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503199360 00000100:00100000:0.0:1784936839.096619:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:0.0:1784936839.096629:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+14:14480:x1871641503199360:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784936839.096701:0:14233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784936839.096729:0:14233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165600/0x6cf7a864723f6f2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9522d expref: 14 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.096749:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:0.0:1784936839.096754:0:14233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784936839.096784:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.096799:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.096809:0:14233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784936839.097150:0:14233:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca16a5ca reply state 00000000bca00b1e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.097161:0:14233:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784936839.097342:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72410603-668c-4b8f-a839-7098c5dcbd21+15:14480:x1871641503199360:12345-192.168.204.1@tcp:36:lhsmtool_posix.0 Request processed in 713us (942us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1784936839.097364:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 52 00000100:00100000:2.0:1784936839.100987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.101181:0:14871:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503199488 00000100:00100000:0.0:1784936839.101191:0:14871:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503199488 00000100:00100000:0.0:1784936839.101263:0:14871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 16 00000100:00100000:0.0:1784936839.101274:0:14871:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72410603-668c-4b8f-a839-7098c5dcbd21+7:2372:x1871641503199488:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784936839.101535:0:14871:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784936839.101539:0:14871:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784936837 00002000:00010000:0.0:1784936839.101541:0:14871:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784936837 00002000:00010000:0.0:1784936839.101544:0:14871:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784936839 -> 1784936837 00002000:00010000:0.0:1784936839.101546:0:14871:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784936839.101606:0:14871:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72410603-668c-4b8f-a839-7098c5dcbd21+8:2372:x1871641503199488:12345-192.168.204.1@tcp:2:lhsmtool_posix.0 Request processed in 333us (627us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784936839.101613:0:14871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 16 00010000:00010000:3.0:1784936839.102055:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.102069:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.102088:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.102095:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936839.102100:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.102108:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.102127:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:3.0:1784936839.102131:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784936839.102137:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.102143:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096ee26aa00/0x6cf7a864723f6f3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.105778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.106420:0:14869:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503199616 00000100:00100000:2.0:1784936839.106531:0:14869:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503199616 00000100:00100000:2.0:1784936839.106591:0:14869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:2.0:1784936839.106667:0:14869:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096edf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72410603-668c-4b8f-a839-7098c5dcbd21+8:2371:x1871641503199616:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784936839.106776:0:14869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.106795:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936839.106799:0:14869:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784936839.106805:0:14869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.106820:0:14869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.106852:0:14869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.106861:0:14869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.106869:0:14869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.107204:0:14869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096f7f4e400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936839.107209:0:14869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.107287:0:14869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.107307:0:14869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.107326:0:14869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001343d6e0/0x6cf7a864723f6f41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936839.107482:0:14869:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096edf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72410603-668c-4b8f-a839-7098c5dcbd21+8:2371:x1871641503199616:12345-192.168.204.1@tcp:1:lhsmtool_posix.0 Request processed in 880us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936839.107491:0:14869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 17 00000100:00100000:3.0:1784936839.110873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.111032:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503199872 00000100:00100000:1.0:1784936839.111043:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503199872 00000100:00100000:1.0:1784936839.111211:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 53 00000100:00100000:1.0:1784936839.111292:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+14:14480:x1871641503199872:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784936839.111394:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.111415:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.111460:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.112197:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.112211:0:14232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 15 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.112286:0:14232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.112341:0:14232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 15 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.112360:0:14232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 15 pid: 14232 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936839.112385:0:14232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1871641524150272:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936839.112596:0:14232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372180 going to sleep for 11 seconds 00000100:00100000:3.0:1784936839.117205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.117402:0:14232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1871641524150272:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936839.117449:0:14232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936839.118289:0:14219:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200000 00000100:00100000:2.0:1784936839.118299:0:14219:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200000 00010000:00010000:2.0:1784936839.118351:0:14219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 16 pid: 14232 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936839.118473:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 13 00000100:00100000:2.0:1784936839.118484:0:14219:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72410603-668c-4b8f-a839-7098c5dcbd21+16:2371:x1871641503200000:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784936839.118501:0:14219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784936839.118525:0:14219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 16 pid: 14232 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.118541:0:14219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 16 pid: 14232 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.118565:0:14219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164c00/0x6cf7a864723f6f1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95226 expref: 16 pid: 14232 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.118580:0:14219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:2.0:1784936839.118586:0:14219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.118596:0:14219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.118615:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.118635:0:14219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784936839.118918:0:14232:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.118926:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784936839.119113:0:14232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1784936839.119466:0:14232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1784936839.119516:0:14232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1784936839.119600:0:14232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14232:1871641524150400:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784936839.119656:0:14232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936839.119698:0:14232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c9372b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784936839.119752:0:14237:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524150400 00000100:00100000:1.0:1784936839.119758:0:14237:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524150400 00000100:00100000:1.0:1784936839.119793:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936839.119800:0:14237:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14232:x1871641524150400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784936839.119874:0:14237:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14232:x1871641524150400:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936839.119896:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784936839.119940:0:14232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14232:1871641524150400:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784936839.121209:0:14219:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72410603-668c-4b8f-a839-7098c5dcbd21+18:2371:x1871641503200000:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 2721us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1784936839.121286:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 13 00000001:00080000:1.0:1784936839.121658:0:14232:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1784936839.121822:0:14232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14232:1871641524150528:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784936839.121880:0:14232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784936839.121976:0:14232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cabc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784936839.122535:0:14237:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641524150528 00000100:00100000:0.0:1784936839.122544:0:14237:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641524150528 00000100:00100000:0.0:1784936839.122587:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784936839.122596:0:14237:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9095c31c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14232:x1871641524150528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784936839.122812:0:14237:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9095c31c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14232:x1871641524150528:12345-0@lo:1000:mdt00_000.0 Request processed in 216us (930us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784936839.122823:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784936839.122915:0:14232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14232:1871641524150528:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1784936839.122955:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.122966:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.122973:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.122979:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164800 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936839.122984:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.122990:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123200:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:3.0:1784936839.123203:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784936839.123208:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123214:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164800/0x6cf7a864723f6f4f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123250:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123256:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123276:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123281:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c165a400 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:3.0:1784936839.123285:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123290:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123299:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:3.0:1784936839.123301:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784936839.123307:0:14232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123333:0:14232:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123341:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.123370:0:14232:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9096f7f4e200/0x6cf7a864723f6eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c9520a expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.123382:0:14232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9096ec899500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1871641524150656:192.168.204.1@tcp:105: 00000100:00100000:3.0:1784936839.124018:0:14232:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096fb9de780 going to sleep for 11 seconds 00000100:00100000:1.0:1784936839.126230:0:14232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9096ec899500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1871641524150656:192.168.204.1@tcp:105: 00010000:00010000:1.0:1784936839.126260:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126269:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c165a400/0x6cf7a864723f6eae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14234 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126302:0:14232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126328:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126339:0:14232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126349:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126356:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126362:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126368:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936839.126371:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126389:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126401:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:1.0:1784936839.126404:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784936839.126407:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126412:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8165e00/0x6cf7a864723f6f56 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126422:0:14232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126451:0:14232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126458:0:14232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126463:0:14232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164200 already unused, calling callback (ffffffffc1e844f0) 00010000:00010000:1.0:1784936839.126477:0:14232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126485:0:14232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126493:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9096caf90800) 00010000:00010000:1.0:1784936839.126495:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784936839.126498:0:14232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.126514:0:14232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f48 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936839.126758:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72410603-668c-4b8f-a839-7098c5dcbd21+18:14480:x1871641503199872:12345-192.168.204.1@tcp:57:lhsmtool_posix.0 Request processed in 15536us (15893us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1784936839.126768:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 53 00000020:00080000:1.0:1784936839.126774:0:14232:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784936839.126989:0:14266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784936839.126995:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784936839.127026:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784936839.127033:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784936839.133335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.133632:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200384 00000100:00100000:1.0:1784936839.133644:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200384 00000100:00100000:1.0:1784936839.133706:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 10 00000100:00100000:1.0:1784936839.133717:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ff88b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+18:14480:x1871641503200384:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784936839.133840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000004:00080000:1.0:1784936839.134486:0:14235:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784936839.134600:0:14235:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1784936839.134642:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.134659:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.134671:0:14235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.134680:0:14235:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.134686:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.134692:0:14235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.134723:0:14235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784936839.134825:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ff88b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+20:14480:x1871641503200384:12345-192.168.204.1@tcp:35:lhsmtool_posix.0 Request processed in 1109us (1512us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1784936839.134834:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 10 00000020:00080000:1.0:1784936839.134840:0:14235:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784936839.134894:0:14235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200128 00000100:00100000:1.0:1784936839.134899:0:14235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200128 00000100:00100000:1.0:1784936839.134922:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 11 00000100:00100000:1.0:1784936839.134929:0:14235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+20:14479:x1871641503200128:12345-192.168.204.1@tcp:49:dd.0 00000100:00100000:1.0:1784936839.134997:0:14235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72410603-668c-4b8f-a839-7098c5dcbd21+20:14479:x1871641503200128:12345-192.168.204.1@tcp:49:dd.0 Request processed in 67us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784936839.135003:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 11 00010000:00010000:2.0:1784936839.135227:0:14221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784936839.135237:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.135246:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164200 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936839.135258:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.135269:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.135286:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9096c7246500) 00010000:00010000:2.0:1784936839.135289:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784936839.135295:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.135302:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9096c8164200/0x6cf7a864723f6f5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.135330:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936839.135333:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784936839.135335:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784936839.247232:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.247284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.247452:0:14875:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200640 00000100:00100000:1.0:1784936839.247464:0:14875:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200640 00000100:00100000:1.0:1784936839.247534:0:14875:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200512 00000100:00100000:1.0:1784936839.247538:0:14875:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200512 00000100:00100000:1.0:1784936839.247563:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:1.0:1784936839.247574:0:14875:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72410603-668c-4b8f-a839-7098c5dcbd21+9:2372:x1871641503200640:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:1.0:1784936839.247619:0:14875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.247643:0:14875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 9 pid: 16013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.247654:0:14875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936839.247659:0:14875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936839.247685:0:14875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.247725:0:14875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 9 pid: 16013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.247743:0:14875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 9 pid: 16013 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936839.247759:0:14875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9095c31c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:14875:1871641524150784:192.168.204.1@tcp:104: 00000100:00100000:1.0:1784936839.247857:0:14875:0:(client.c:2702:ptlrpc_set_wait()) set ffff9096c7cab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784936839.251091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:2.0:1784936839.251369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:3.0:1784936839.251472:0:14218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503201024 00000100:00100000:3.0:1784936839.251482:0:14218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503201024 00010000:00010000:3.0:1784936839.251523:0:14218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 10 pid: 16013 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.251559:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:3.0:1784936839.251569:0:14218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72410603-668c-4b8f-a839-7098c5dcbd21+10:2374:x1871641503201024:12345-192.168.204.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784936839.251585:0:14218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784936839.251612:0:14218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 10 pid: 16013 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.251628:0:14218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 10 pid: 16013 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.251656:0:14218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1784936839.251668:0:14218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.251675:0:14218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.251686:0:14218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.251707:0:14218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784936839.251867:0:14218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72410603-668c-4b8f-a839-7098c5dcbd21+10:2374:x1871641503201024:12345-192.168.204.1@tcp:103:ldlm_bl.0 Request processed in 298us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784936839.251889:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 14 00000100:00100000:0.0:1784936839.252070:0:14876:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784936839.252078:0:14876:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00010000:00010000:1.0:1784936839.252750:0:14875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ed5d58/0x6cf7a864723f6f33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.1@tcp remote: 0xdb594e5d35c95234 expref: 9 pid: 16013 timeout: 604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784936839.252769:0:14875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9095c31c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:14875:1871641524150784:192.168.204.1@tcp:104: 00010000:00010000:1.0:1784936839.252790:0:14875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.252800:0:14875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.252808:0:14875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.253582:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200768 00000100:00100000:0.0:1784936839.253590:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200768 00000100:00100000:3.0:1784936839.257252:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1784936839.257270:0:16366:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72410603-668c-4b8f-a839-7098c5dcbd21+10:2372:x1871641503200512:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:3.0:1784936839.257326:0:16366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.257346:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.257351:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.257358:0:16366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.257372:0:16366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.259159:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.259269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.259326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.259351:0:14874:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1784936839.259359:0:14874:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1784936839.259492:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503200896 00000100:00100000:0.0:1784936839.259501:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503200896 00000100:00100000:0.0:1784936839.259547:0:14874:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1784936839.259552:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503201152 00000100:00100000:0.0:1784936839.259555:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503201152 00000100:00100000:0.0:1784936839.259569:0:14874:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1784936839.259575:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503201280 00000100:00100000:0.0:1784936839.259577:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503201280 00000100:00100000:0.0:1784936839.259972:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 2 00000100:00100000:0.0:1784936839.259985:0:16367:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096ec89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72410603-668c-4b8f-a839-7098c5dcbd21+14:2371:x1871641503200768:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:0.0:1784936839.260031:0:16367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.260048:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936839.260053:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936839.260059:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.260074:0:16367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.263950:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:0.0:1784936839.264058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.1@tcp (source: 12345-192.168.204.1@tcp) 00000100:00100000:1.0:1784936839.264599:0:14874:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784936839.264871:0:14876:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784936839.264901:0:14874:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1784936839.265329:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503201408 00000100:00100000:0.0:1784936839.265340:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503201408 00000100:00100000:0.0:1784936839.265403:0:14874:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1784936839.265410:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1871641503201536 00000100:00100000:0.0:1784936839.265417:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1871641503201536 00000100:00100000:1.0:1784936839.266417:0:16368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 3 00000100:00100000:3.0:1784936839.267015:0:14876:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:1.0:1784936839.267245:0:16368:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:72410603-668c-4b8f-a839-7098c5dcbd21+17:2372:x1871641503200896:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:1.0:1784936839.267289:0:16368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.267318:0:16368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936839.267324:0:16368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784936839.267332:0:16368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784936839.267348:0:16368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.269360:0:16369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 4 00000100:00100000:3.0:1784936839.269375:0:16369:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:72410603-668c-4b8f-a839-7098c5dcbd21+18:2371:x1871641503201152:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:3.0:1784936839.269415:0:16369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.269464:0:16369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.269469:0:16369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.269478:0:16369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.269505:0:16369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936839.344144:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1784936839.344161:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:2.0:1784936839.344172:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1784936839.347968:0:14875:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1784936839.347979:0:14875:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1784936837 -> 1784936839 00002000:00010000:3.0:1784936839.347982:0:14875:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784936837 -> 1784936839 00002000:00010000:3.0:1784936839.347984:0:14875:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:3.0:1784936839.348001:0:14875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348015:0:14875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348025:0:14875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348032:0:14875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8165e00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936839.348037:0:14875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348047:0:14875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348070:0:14875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348092:0:14875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddb73d0/0x6cf7a864723f6f64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.348197:0:14875:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72410603-668c-4b8f-a839-7098c5dcbd21+20:2372:x1871641503200640:12345-192.168.204.1@tcp:4:dd.0 Request processed in 100618us (100968us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1784936839.348207:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 0 00000100:00100000:3.0:1784936839.348245:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 5 00000100:00100000:3.0:1784936839.348257:0:14875:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c8a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72410603-668c-4b8f-a839-7098c5dcbd21+19:2372:x1871641503201280:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:3.0:1784936839.348290:0:14875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.348302:0:14875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.352833:0:14875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.352852:0:14875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.352875:0:14875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936839.406843:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1784936839.406884:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1784936839.407191:0:16367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00010000:00010000:2.0:1784936839.407210:0:16367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.407223:0:16367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.407249:0:16367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.407257:0:16367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26aa00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936839.407262:0:16367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.407271:0:16367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.407293:0:16367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.407301:0:16367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63d8e75/0x6cf7a864723f6f72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936839.407399:0:16367:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72410603-668c-4b8f-a839-7098c5dcbd21+21:2371:x1871641503200768:12345-192.168.204.1@tcp:4:dd.0 Request processed in 147412us (156313us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784936839.407414:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 2 00002000:00010000:3.0:1784936839.409134:0:16366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1784936839.409154:0:16366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409167:0:16366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409195:0:16366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409203:0:16366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d466bc00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936839.409208:0:16366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409218:0:16366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409237:0:16366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409244:0:16366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000508a880c/0x6cf7a864723f6f6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.409344:0:16366:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096ec820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72410603-668c-4b8f-a839-7098c5dcbd21+19:2372:x1871641503200512:12345-192.168.204.1@tcp:4:dd.0 Request processed in 152075us (162055us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1784936839.409355:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 1 00000100:00100000:3.0:1784936839.409386:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 6 00000100:00100000:3.0:1784936839.409397:0:16366:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72410603-668c-4b8f-a839-7098c5dcbd21+18:2371:x1871641503201408:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:3.0:1784936839.409513:0:16366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409527:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.409538:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784936839.409545:0:16366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.409558:0:16366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.413345:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.1@tcp, seq: 7 00000100:00100000:0.0:1784936839.413363:0:16367:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9096c4ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72410603-668c-4b8f-a839-7098c5dcbd21+19:2371:x1871641503201536:12345-192.168.204.1@tcp:4:dd.0 00010000:00010000:0.0:1784936839.413404:0:16367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.413422:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936839.413441:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784936839.413449:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.413463:0:16367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784936839.450059:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:2.0:1784936839.450093:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1784936839.450157:0:14875:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1784936839.450162:0:14875:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1784936839.450177:0:14875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.450209:0:14875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.450219:0:14875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.450226:0:14875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d466be00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:2.0:1784936839.450230:0:14875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.450240:0:14875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.450263:0:14875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784936839.450270:0:14875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a1ab32/0x6cf7a864723f6f87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784936839.450374:0:14875:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72410603-668c-4b8f-a839-7098c5dcbd21+17:2372:x1871641503201280:12345-192.168.204.1@tcp:4:dd.0 Request processed in 102115us (191042us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784936839.450383:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 5 00010000:00010000:0.0:1784936839.450791:0:16369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.450801:0:16369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.450810:0:16369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.450816:0:16369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d466ba00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936839.450819:0:16369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.450845:0:16369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.450858:0:16369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.450866:0:16369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc13698/0x6cf7a864723f6f80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.450903:0:16369:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:72410603-668c-4b8f-a839-7098c5dcbd21+15:2371:x1871641503201152:12345-192.168.204.1@tcp:4:dd.0 Request processed in 181532us (191632us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1784936839.450910:0:16369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 4 00010000:00010000:3.0:1784936839.451273:0:16368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.451282:0:16368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.451290:0:16368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.451297:0:16368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096c8164e00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936839.451300:0:16368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.451317:0:16368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.451328:0:16368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.451335:0:16368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf6129e9/0x6cf7a864723f6f79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.451396:0:16368:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c8a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:72410603-668c-4b8f-a839-7098c5dcbd21+13:2372:x1871641503200896:12345-192.168.204.1@tcp:4:dd.0 Request processed in 184161us (192245us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1784936839.451404:0:16368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 3 00000001:00080000:1.0:1784936839.489446:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1784936839.489547:0:16366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1784936839.489565:0:16366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.489579:0:16366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.489589:0:16366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.489597:0:16366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096d466ae00 already unused, calling callback (ffffffffc1446310) 00010000:00010000:0.0:1784936839.489602:0:16366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.489632:0:16366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.489652:0:16366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784936839.489661:0:16366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057048c8d/0x6cf7a864723f6f8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784936839.489777:0:16366:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:72410603-668c-4b8f-a839-7098c5dcbd21+7:2371:x1871641503201408:12345-192.168.204.1@tcp:4:dd.0 Request processed in 80377us (225833us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1784936839.489789:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 6 00010000:00010000:3.0:1784936839.490742:0:16367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.490757:0:16367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.490764:0:16367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.490771:0:16367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9096ee26b400 already unused, calling callback (ffffffffc1446310) 00010000:00010000:3.0:1784936839.490775:0:16367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.490783:0:16367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.490797:0:16367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784936839.490803:0:16367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a5c7ecd/0x6cf7a864723f6f95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784936839.491078:0:16367:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9096c4ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:72410603-668c-4b8f-a839-7098c5dcbd21+5:2371:x1871641503201536:12345-192.168.204.1@tcp:4:dd.0 Request processed in 77718us (227016us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1784936839.491089:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.1@tcp, seq: 7 00010000:00010000:1.0:1784936839.624703:0:14222:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784936840.137146:0:14266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784936840.137158:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784936840.137192:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784936840.137211:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1784936840.650057:0:15351:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784936840.661140:0:16407:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1784936841.673073:0:14221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29294 lines, 29294 kept, 0 dropped, 0 bad.